-- Logs begin at Wed 2022-09-21 11:17:05 UTC, end at Wed 2022-09-21 12:14:18 UTC. -- Sep 21 11:47:51.181931 dv-osbrick-855012-2-ceph systemd[1]: Starting Devstack devstack@keystone.service... Sep 21 11:47:51.191292 dv-osbrick-855012-2-ceph devstack@keystone.service[88107]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 21 11:47:51.193042 dv-osbrick-855012-2-ceph devstack@keystone.service[88107]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 21 11:47:51 2022] *** Sep 21 11:47:51.193042 dv-osbrick-855012-2-ceph devstack@keystone.service[88107]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 21 11:47:51.193042 dv-osbrick-855012-2-ceph devstack@keystone.service[88107]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 21 11:47:51.193042 dv-osbrick-855012-2-ceph devstack@keystone.service[88107]: nodename: dv-osbrick-855012-2-ceph Sep 21 11:47:51.193042 dv-osbrick-855012-2-ceph devstack@keystone.service[88107]: machine: x86_64 Sep 21 11:47:51.193042 dv-osbrick-855012-2-ceph devstack@keystone.service[88107]: clock source: unix Sep 21 11:47:51.193042 dv-osbrick-855012-2-ceph devstack@keystone.service[88107]: pcre jit disabled Sep 21 11:47:51.193042 dv-osbrick-855012-2-ceph devstack@keystone.service[88107]: detected number of CPU cores: 4 Sep 21 11:47:51.193042 dv-osbrick-855012-2-ceph devstack@keystone.service[88107]: current working directory: / Sep 21 11:47:51.193042 dv-osbrick-855012-2-ceph devstack@keystone.service[88107]: detected binary path: /usr/bin/uwsgi-core Sep 21 11:47:51.193042 dv-osbrick-855012-2-ceph devstack@keystone.service[88107]: your processes number limit is 47680 Sep 21 11:47:51.193042 dv-osbrick-855012-2-ceph devstack@keystone.service[88107]: your memory page size is 4096 bytes Sep 21 11:47:51.193767 dv-osbrick-855012-2-ceph devstack@keystone.service[88107]: detected max file descriptor number: 2048 Sep 21 11:47:51.193767 dv-osbrick-855012-2-ceph devstack@keystone.service[88107]: lock engine: pthread robust mutexes Sep 21 11:47:51.193767 dv-osbrick-855012-2-ceph devstack@keystone.service[88107]: thunder lock: enabled Sep 21 11:47:51.193767 dv-osbrick-855012-2-ceph devstack@keystone.service[88107]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 21 11:47:51.193767 dv-osbrick-855012-2-ceph devstack@keystone.service[88107]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 21 11:47:51.237553 dv-osbrick-855012-2-ceph devstack@keystone.service[88107]: Python main interpreter initialized at 0x556a74a559c0 Sep 21 11:47:51.237553 dv-osbrick-855012-2-ceph devstack@keystone.service[88107]: python threads support enabled Sep 21 11:47:51.237553 dv-osbrick-855012-2-ceph devstack@keystone.service[88107]: your server socket listen backlog is limited to 100 connections Sep 21 11:47:51.237553 dv-osbrick-855012-2-ceph devstack@keystone.service[88107]: your mercy for graceful operations on workers is 90 seconds Sep 21 11:47:51.237952 dv-osbrick-855012-2-ceph devstack@keystone.service[88107]: mapped 403077 bytes (393 KB) for 2 cores Sep 21 11:47:51.238036 dv-osbrick-855012-2-ceph devstack@keystone.service[88107]: *** Operational MODE: preforking *** Sep 21 11:47:51.238229 dv-osbrick-855012-2-ceph devstack@keystone.service[88107]: *** uWSGI is running in multiple interpreter mode *** Sep 21 11:47:51.238229 dv-osbrick-855012-2-ceph devstack@keystone.service[88107]: spawned uWSGI master process (pid: 88107) Sep 21 11:47:51.238431 dv-osbrick-855012-2-ceph systemd[1]: Started Devstack devstack@keystone.service. Sep 21 11:47:51.238999 dv-osbrick-855012-2-ceph devstack@keystone.service[88107]: spawned uWSGI worker 1 (pid: 88124, cores: 1) Sep 21 11:47:51.240115 dv-osbrick-855012-2-ceph devstack@keystone.service[88107]: spawned uWSGI worker 2 (pid: 88125, cores: 1) Sep 21 11:47:51.240115 dv-osbrick-855012-2-ceph devstack@keystone.service[88107]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 21 11:47:55.813699 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 11:47:55.813699 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: from cryptography.utils import int_from_bytes Sep 21 11:47:55.814534 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 11:47:55.814534 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: from cryptography.utils import int_from_bytes Sep 21 11:47:55.814672 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 11:47:55.814672 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: from cryptography.utils import int_from_bytes Sep 21 11:47:55.815110 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 11:47:55.815110 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: from cryptography.utils import int_from_bytes Sep 21 11:47:55.863354 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 21 11:47:55.863512 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 21 11:47:55.863659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] command line args: [] {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 21 11:47:55.863804 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 21 11:47:55.863921 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 21 11:47:55.864031 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 21 11:47:55.864124 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ================================================================================ {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 21 11:47:55.864235 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] command line args: [] {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 21 11:47:55.864365 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] admin_token = **** {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.864505 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 21 11:47:55.864592 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] config_dir = [] {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.864678 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ================================================================================ {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 21 11:47:55.864758 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.864920 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] admin_token = **** {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.865006 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] config_source = [] {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.865109 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] debug = True {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.865194 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] config_dir = [] {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.865304 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.865570 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.865570 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] config_source = [] {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.865687 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.865752 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] debug = True {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.865823 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.865889 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.866069 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.866155 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.866218 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.866286 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.866474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.866585 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] list_limit = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.866681 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] log_config_append = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.866781 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.866890 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.866997 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] list_limit = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.867095 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] log_dir = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.867190 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] log_config_append = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.867298 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] log_file = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.867395 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.867498 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.867629 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] log_dir = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.867629 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] log_file = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.867820 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.867896 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.868036 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.868125 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.868211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.868350 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.868455 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.868558 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.868663 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.868756 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.868832 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.868832 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.869040 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.869162 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.869252 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.869337 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.869462 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.869546 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.869624 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.869748 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.869831 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.869944 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.870034 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.870171 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.870253 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.870414 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.870500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.870660 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.870905 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.871037 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.871121 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] publish_errors = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.871298 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.871384 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.871523 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.871609 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] publish_errors = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.871691 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.871771 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.871924 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.872027 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.872180 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.872283 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.872410 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] standard_threads = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.872491 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.872635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.872714 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.872865 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] standard_threads = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.872950 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.873030 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.873108 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.873187 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] use_journal = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.873322 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.873456 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] use_json = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.874172 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.874272 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] use_stderr = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.874348 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] use_journal = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.874420 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] use_syslog = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.874491 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] use_json = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.874573 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.874646 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] use_stderr = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.874717 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.874793 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] use_syslog = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.874896 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.874975 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 11:47:55.875153 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.875233 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.875386 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.875471 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.875630 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.875708 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.875862 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.875940 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.876127 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.876246 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.876349 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.876493 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.876627 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.876725 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.876820 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.876926 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.877052 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.877132 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.877277 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.877361 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.877517 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.877595 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.877746 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.877837 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.877988 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.878076 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.878222 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.878303 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.878449 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.878526 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.878699 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.878780 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.878935 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.879019 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.879172 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.879330 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.879406 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.879476 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.879635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.879712 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.879878 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.879962 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.880147 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.880226 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.880391 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.880469 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.880616 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.880706 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.880843 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.880921 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.881068 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.881145 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.881295 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.881385 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.881525 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.881601 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.881758 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.881836 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.881981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.882397 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.882477 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.882548 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.882624 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.882700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.882773 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.882850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.882923 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.882998 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.883107 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.883185 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.883331 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.883419 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.883563 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.883646 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.883795 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.883873 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.884041 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.884139 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.884269 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.884346 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.884494 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.884571 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.884719 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.884871 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.884946 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.885021 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.885161 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.885244 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.885396 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.885482 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.885625 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.885707 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.885852 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.885929 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.886082 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.886168 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.886309 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.886385 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.886543 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.886619 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.886765 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.886857 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.886996 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.887080 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.887223 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.887299 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.887451 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.887528 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.887680 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.887763 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.887909 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.888043 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.888158 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.888238 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.888390 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.888511 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.888618 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.888746 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.888867 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.888978 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.889128 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.889217 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.889476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.889560 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.889709 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.889789 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.889936 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.890027 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.890168 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.890248 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.890400 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.890481 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.890635 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.890714 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.890873 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.890951 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.891129 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.891206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.891372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.891451 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.891605 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.891682 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.891838 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.891916 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.892098 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.892202 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.892329 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.892397 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.892560 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.892626 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.892791 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.892862 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.893030 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.893269 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.893512 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.893685 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.893922 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.894236 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.894493 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.894736 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.894813 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.894974 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.895063 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.895212 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.895290 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.895450 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.895529 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.895688 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.895854 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.895935 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.896021 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.896212 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.896291 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.896451 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.896537 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.896693 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.896770 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.896930 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.897014 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.897163 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.897315 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.897389 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.897459 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.897618 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.897697 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.897850 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.897936 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.898080 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.898158 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.898307 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.898383 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.898533 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.898609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.898759 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.898837 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.898986 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.899064 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.899213 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.899298 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.899449 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.899531 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.899679 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.899757 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.899922 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.900079 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.900166 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.900239 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.900422 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.900498 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.900677 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.900754 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.900909 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] auth.external = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.900997 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.901134 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] auth.external = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.901215 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.901362 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.901441 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.901650 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.901727 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.901877 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.901956 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] auth.password = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.902102 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] auth.password = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.902177 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] auth.token = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.902328 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] auth.token = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.902406 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.902560 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.902638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.902787 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.902873 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.903024 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.903101 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.903247 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.903332 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.903491 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.903577 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.903719 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.903797 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.903946 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.904043 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] credential.caching = True {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.904211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] credential.caching = True {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.904289 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.904455 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.904534 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.904720 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.904800 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.904965 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.905043 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.905208 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.905287 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.905441 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.905521 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.905670 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.905747 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.905920 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.906005 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.906153 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.906232 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.906391 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.906468 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.906639 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.906718 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.906900 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.906979 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.907146 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.907223 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.907388 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.907473 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.907627 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.907748 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.907865 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] federation.caching = True {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.907943 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.908120 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] federation.caching = True {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.908212 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.908352 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.908430 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.908594 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.908672 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.908820 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.908906 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.909051 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.909135 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.909287 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.909365 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.909516 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.909602 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.909761 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.909838 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.909989 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.910073 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.910234 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.910321 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.910461 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.910539 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.910696 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] identity.caching = True {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.910774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.910925 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] identity.caching = True {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.911079 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.911155 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.911226 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.911400 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.911479 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.911630 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.911716 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.911859 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.911938 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.912110 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.912189 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.912340 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.912429 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.912572 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.912651 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.912815 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.912900 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.913042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.913128 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.913276 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.913386 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.913493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.913567 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.913725 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.913821 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.913960 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.914040 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.914204 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.914281 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.914446 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.914532 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.914690 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.914768 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.914930 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.915018 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.915180 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.915267 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.915413 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.915491 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.915639 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.915716 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.915865 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.915944 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.916111 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.916191 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.916334 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.916412 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.916566 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.916646 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.916801 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.916885 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.917051 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.917137 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.917263 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.917342 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.917737 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.917821 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.917988 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.918067 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.918218 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.918297 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.918446 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.918524 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.918688 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.918766 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.918914 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.918994 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.919144 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.919220 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.919368 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.919444 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.919590 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.919669 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.919821 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.919908 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.920073 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.920157 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.920808 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.920897 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.921050 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.921129 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.921282 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.921361 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.921524 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.921604 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.921751 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.921829 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.921980 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.922057 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.922204 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.922284 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.922446 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.922524 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.922677 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.922755 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.922906 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.922985 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.923135 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.923214 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.923368 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.user = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.923460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.923587 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.user = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.923667 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.923822 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.923908 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.924084 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.924163 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.924326 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.924405 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.924569 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.924653 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.924810 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.924888 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.925039 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.925119 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.925269 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.925348 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.925493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.925570 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.925723 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.925801 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.925950 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.926028 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.926176 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.926253 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.926405 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.926490 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.926644 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.926761 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.926886 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.926965 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.927125 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.927204 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.927366 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.927444 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.927596 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.927674 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.927821 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.927900 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.928087 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.928184 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.928322 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.928411 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.928551 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.928631 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.928779 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.928857 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.929010 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.929090 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.929251 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.929332 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.929481 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.929558 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.929711 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.929789 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.929947 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.930026 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.930173 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.930250 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.930407 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.930485 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.930635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.930713 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.930865 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.930944 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.931096 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.931174 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.931334 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.931413 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.931565 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.931643 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.931787 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.931872 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.932044 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.932126 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] resource.caching = True {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.932283 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] resource.caching = True {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.932362 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.932528 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.932617 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.932762 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.932841 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.932990 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.933067 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.933234 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.933322 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.933465 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.933542 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.933694 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.933772 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.933933 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.934085 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.934161 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.934231 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.934385 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.934463 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] role.caching = True {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.934613 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] role.caching = True {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.934699 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] role.driver = sql {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.934843 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.934922 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] role.driver = sql {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.935067 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.935145 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.935312 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.935399 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.935554 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.935634 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.935798 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.935877 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.936607 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.936760 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.936889 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.937017 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.937155 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.937289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.937395 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.937509 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.937617 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.937719 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.937824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.937928 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.938032 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.938145 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.938281 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.938396 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.938503 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.938611 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.938756 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.938906 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.939140 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.939218 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.939375 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.939459 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.939625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.939703 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.939872 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.939949 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.940143 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.940223 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.940379 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.940460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.940608 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.940692 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.940859 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.940937 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.941095 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.941173 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.941328 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.941407 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.941554 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.941632 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.941785 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.941864 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.942014 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.942092 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.942261 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.942339 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.942513 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.942591 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.942750 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.942839 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.942982 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.943059 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.943209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.943287 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.943433 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.943510 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] token.caching = True {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.943664 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] token.caching = True {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.943743 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.943896 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.943976 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.944153 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.944231 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.944384 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.944461 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.944637 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.944717 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.944870 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.944948 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.945100 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.945177 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.945340 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.945420 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.945578 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.945657 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.945812 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.945890 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.946040 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.946118 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.946272 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.946350 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.946504 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.946582 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.946747 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.946827 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.946999 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.947086 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.947235 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.947327 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.947473 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.947553 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.947736 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.947825 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] database.connection = **** {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.947978 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.948077 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] database.connection = **** {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.948244 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.948321 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.948478 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.948569 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.948710 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.948788 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.948942 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.949021 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.949171 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.949259 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.949403 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.949483 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.949633 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.949712 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.949862 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.949950 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.950094 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.950172 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.950323 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.950399 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.950555 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.950641 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.950783 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.950861 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.951023 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.951101 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.951252 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.951337 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.951484 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.951580 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.951750 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.951828 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.951984 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.952096 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.952172 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 21 11:47:55.952244 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 11:47:55.952392 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 21 11:47:55.981657 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:55.981823 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:55.981905 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:55.981979 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:55.982100 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:55.982185 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:55.991071 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:55.991170 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.018668 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.018890 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.022904 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.023136 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.072504 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.073100 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.121502 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.121668 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.122978 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.123214 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.188352 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.188505 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.188575 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.188651 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.188781 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.188872 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.189083 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.189179 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.189256 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.189341 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.189419 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.189494 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.212011 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.212246 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.212337 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.212472 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.212556 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.212695 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.212780 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.212915 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.213008 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.213126 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.213210 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.213335 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.213420 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.213545 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.224825 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.225133 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.237210 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.237435 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.237540 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.237656 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.237740 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.237875 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.237959 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.238088 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.238182 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.238298 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.238392 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.238508 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.238593 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.238720 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 11:47:56.255666 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.255871 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 21 11:47:56.256232 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.256320 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.256428 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 21 11:47:56.256527 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 21 11:47:56.256697 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.256783 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.256957 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 21 11:47:56.257040 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.257212 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.257298 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.257464 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.257546 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.257724 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.257978 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.266962 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.267237 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.267492 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.267577 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.267765 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.267862 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.268061 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.268348 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.274701 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.275224 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.277575 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.277859 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.278122 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.278207 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.278409 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.278493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.278689 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.278773 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.278948 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.279032 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.279212 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.279305 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.279482 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.279566 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.280286 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.280398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.280560 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.280680 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.280825 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.280955 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.281230 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.281499 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.303422 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.304292 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.304890 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.305170 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.305752 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.306037 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.309651 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.309936 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.310540 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.310826 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.312322 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.313235 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.318632 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.318914 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.319569 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.319855 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.322827 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.323116 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.323393 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.323776 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.323905 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.324075 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.324205 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.324339 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.324471 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.324601 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.324739 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.324880 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.325010 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.325267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.325542 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.325815 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.340689 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.340960 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.342024 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.342330 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.344811 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.346264 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.347875 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.348301 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.349373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.349785 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.352487 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.353966 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.355556 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.357112 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.359154 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.359457 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.359742 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.360162 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.360454 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.360743 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.360942 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.361076 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.361317 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.361725 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.362017 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.362307 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.376889 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.377172 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.377432 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.377689 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.378662 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.378953 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.379223 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.379486 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.384349 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.385975 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.386202 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.387487 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.387760 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.387844 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.389408 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.389687 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.390421 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.390701 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.390995 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.391282 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.391555 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.392335 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.392620 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.392916 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.393207 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.393490 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.402681 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.402963 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.403243 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.403529 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.403808 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.404120 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.404396 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.404742 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.405026 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.405306 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.405595 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.405876 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.406161 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.406436 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.419854 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.422742 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.423379 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.425778 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.426249 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.427659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.428677 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.429126 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.429409 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.429701 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.430091 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.431554 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.431839 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.432156 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.436666 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.438120 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.439113 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.440606 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.440982 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.441277 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.441558 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.441831 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.443449 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.443740 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.444053 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.444334 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.449893 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.450185 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.450464 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.452539 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.452836 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.453126 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.458173 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.458452 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.458727 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.458995 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.459266 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.459534 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.459801 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.460108 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.460385 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.460648 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.460849 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 11:47:56.460932 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.461135 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.461229 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.461417 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.461502 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.461670 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.461754 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.461953 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.462227 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.462502 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.462793 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.463082 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.463350 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.463622 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.463890 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.464183 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.464446 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 11:47:56.494634 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556a74a559c0 pid: 88124 (default app) Sep 21 11:47:56.497698 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556a74a559c0 pid: 88125 (default app) Sep 21 11:47:56.497992 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4bac7-4e74-4950-8061-84b38e40ad4d None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:47:56.498272 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4bac7-4e74-4950-8061-84b38e40ad4d None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:47:56.499077 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4bac7-4e74-4950-8061-84b38e40ad4d None None] PATH_INFO: `/v3` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:47:56.503180 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Wed Sep 21 11:47:56 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:03.762673 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ea265-4d14-4b7d-aaaf-e88aac4ccdb4 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:03.763203 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ea265-4d14-4b7d-aaaf-e88aac4ccdb4 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:03.763203 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ea265-4d14-4b7d-aaaf-e88aac4ccdb4 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:03.768074 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 11:48:03.773337 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd88d0-182a-498e-965f-f00db3825f5e None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:03.773929 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd88d0-182a-498e-965f-f00db3825f5e None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:03.773929 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd88d0-182a-498e-965f-f00db3825f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:03.850098 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: INFO dbcounter [None req-4dbd88d0-182a-498e-965f-f00db3825f5e None None] Registered counter for database keystone Sep 21 11:48:03.869490 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG oslo_db.sqlalchemy.engines [None req-4dbd88d0-182a-498e-965f-f00db3825f5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 11:48:03.876672 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writer thread running {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 11:48:04.051661 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG passlib.handlers.bcrypt [None req-4dbd88d0-182a-498e-965f-f00db3825f5e None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88124) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 21 11:48:04.052075 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG passlib.handlers.bcrypt [None req-4dbd88d0-182a-498e-965f-f00db3825f5e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88124) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 21 11:48:04.111796 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-4dbd88d0-182a-498e-965f-f00db3825f5e None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:04.113372 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-4dbd88d0-182a-498e-965f-f00db3825f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:04.243565 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 21 11:48:04.781347 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ea265-4d14-4b7d-aaaf-e88aac4ccdb4 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:04.855886 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: INFO dbcounter [None req-3b3ea265-4d14-4b7d-aaaf-e88aac4ccdb4 None None] Registered counter for database keystone Sep 21 11:48:04.876602 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG oslo_db.sqlalchemy.engines [None req-3b3ea265-4d14-4b7d-aaaf-e88aac4ccdb4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88125) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 11:48:04.882669 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writer thread running {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 11:48:05.001181 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ea265-4d14-4b7d-aaaf-e88aac4ccdb4 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:05.005385 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838ec13-a330-461f-8a5d-e318083b4e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:05.005999 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838ec13-a330-461f-8a5d-e318083b4e5c admin admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:05.006272 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838ec13-a330-461f-8a5d-e318083b4e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:05.006539 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838ec13-a330-461f-8a5d-e318083b4e5c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:05.015191 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838ec13-a330-461f-8a5d-e318083b4e5c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:05.066309 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6838ec13-a330-461f-8a5d-e318083b4e5c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 21 11:48:05.066638 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838ec13-a330-461f-8a5d-e318083b4e5c admin admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:05.075895 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Wed Sep 21 11:48:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 11:48:05.082559 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd88d0-182a-498e-965f-f00db3825f5e None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:05.099390 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd88d0-182a-498e-965f-f00db3825f5e None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:05.103789 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d9c6e-7bac-4c2b-9551-f726be797859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:05.104911 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d9c6e-7bac-4c2b-9551-f726be797859 admin admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:05.105191 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d9c6e-7bac-4c2b-9551-f726be797859 admin admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:05.105456 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d9c6e-7bac-4c2b-9551-f726be797859 admin admin] PATH_INFO: `/v3/projects/e314d339abaf4ce28ec0c1d1e6483dff` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:05.109328 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d9c6e-7bac-4c2b-9551-f726be797859 admin admin] RBAC: Authorizing `identity:get_project(project_id=e314d339abaf4ce28ec0c1d1e6483dff)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:05.159385 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: WARNING keystone.common.rbac_enforcer.enforcer [None req-599d9c6e-7bac-4c2b-9551-f726be797859 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 21 11:48:05.159726 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d9c6e-7bac-4c2b-9551-f726be797859 admin admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:05.164248 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Wed Sep 21 11:48:05 2022] GET /identity/v3/projects/e314d339abaf4ce28ec0c1d1e6483dff => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:48:07.534243 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0830bf-bc77-4587-b73b-5595af88279a None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:07.534793 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0830bf-bc77-4587-b73b-5595af88279a None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:07.534793 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0830bf-bc77-4587-b73b-5595af88279a None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:07.538867 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 11:48:07.544552 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e8b53-019b-4eb5-9f65-16425c6f861a None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:07.544941 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e8b53-019b-4eb5-9f65-16425c6f861a None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:07.545091 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e8b53-019b-4eb5-9f65-16425c6f861a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:07.565431 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-f27e8b53-019b-4eb5-9f65-16425c6f861a None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:07.566905 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-f27e8b53-019b-4eb5-9f65-16425c6f861a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:07.574618 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 21 11:48:07.892527 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0830bf-bc77-4587-b73b-5595af88279a None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:07.905257 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0830bf-bc77-4587-b73b-5595af88279a None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:07.909456 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb772c9-93f5-4995-a906-641b85489dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:07.910044 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb772c9-93f5-4995-a906-641b85489dfb admin admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:07.910324 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb772c9-93f5-4995-a906-641b85489dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:07.910594 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb772c9-93f5-4995-a906-641b85489dfb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:07.918420 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb772c9-93f5-4995-a906-641b85489dfb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:07.920253 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb772c9-93f5-4995-a906-641b85489dfb admin admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:07.928899 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Wed Sep 21 11:48:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 11:48:07.934062 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e8b53-019b-4eb5-9f65-16425c6f861a None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:07.943058 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e8b53-019b-4eb5-9f65-16425c6f861a None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:07.947378 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6004eb-ab17-462d-b69d-da54b24da7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:07.948017 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6004eb-ab17-462d-b69d-da54b24da7ee admin admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:07.948296 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6004eb-ab17-462d-b69d-da54b24da7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:07.948562 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6004eb-ab17-462d-b69d-da54b24da7ee admin admin] PATH_INFO: `/v3/users/371d9f7c2d964f04b62c347e6b182e88` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:07.949851 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6004eb-ab17-462d-b69d-da54b24da7ee admin admin] RBAC: Authorizing `identity:get_user(user_id=371d9f7c2d964f04b62c347e6b182e88)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:07.952198 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6004eb-ab17-462d-b69d-da54b24da7ee admin admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:07.953703 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Wed Sep 21 11:48:07 2022] GET /identity/v3/users/371d9f7c2d964f04b62c347e6b182e88 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:10.405733 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e57f0-8233-4e91-96dc-02e2768b6b78 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:10.406289 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e57f0-8233-4e91-96dc-02e2768b6b78 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:10.406289 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e57f0-8233-4e91-96dc-02e2768b6b78 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:10.407597 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:10.412700 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67429c8d-9b0a-47d6-9046-ebe6775fb567 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:10.413123 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67429c8d-9b0a-47d6-9046-ebe6775fb567 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:10.413252 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67429c8d-9b0a-47d6-9046-ebe6775fb567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:10.431261 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-67429c8d-9b0a-47d6-9046-ebe6775fb567 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:10.432448 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-67429c8d-9b0a-47d6-9046-ebe6775fb567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:10.439436 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50b52c-0333-4fb7-844d-a34f3b23bd17 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:10.439711 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50b52c-0333-4fb7-844d-a34f3b23bd17 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:10.439978 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50b52c-0333-4fb7-844d-a34f3b23bd17 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:10.441297 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:10.446328 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330dcc22-caf2-43f7-acf8-8165cbb194a0 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:10.446608 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330dcc22-caf2-43f7-acf8-8165cbb194a0 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:10.446875 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330dcc22-caf2-43f7-acf8-8165cbb194a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:10.487827 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG passlib.handlers.bcrypt [None req-330dcc22-caf2-43f7-acf8-8165cbb194a0 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88125) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 21 11:48:10.488242 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG passlib.handlers.bcrypt [None req-330dcc22-caf2-43f7-acf8-8165cbb194a0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88125) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 21 11:48:10.516245 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:48:10.537557 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-330dcc22-caf2-43f7-acf8-8165cbb194a0 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:10.539120 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-330dcc22-caf2-43f7-acf8-8165cbb194a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:10.638679 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 11:48:10.843969 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67429c8d-9b0a-47d6-9046-ebe6775fb567 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:10.868231 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:10.957458 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330dcc22-caf2-43f7-acf8-8165cbb194a0 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:11.059345 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67429c8d-9b0a-47d6-9046-ebe6775fb567 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:11.061941 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330dcc22-caf2-43f7-acf8-8165cbb194a0 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:11.064220 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:11.093681 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdd3d3-98d3-426f-9fa6-2b579fd8fad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:11.094361 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdd3d3-98d3-426f-9fa6-2b579fd8fad2 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:11.094577 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdd3d3-98d3-426f-9fa6-2b579fd8fad2 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:11.094847 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdd3d3-98d3-426f-9fa6-2b579fd8fad2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:11.100299 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906af55b-a0f0-48a7-b28b-5ea7a6971c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:11.101158 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906af55b-a0f0-48a7-b28b-5ea7a6971c7b None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:11.101437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906af55b-a0f0-48a7-b28b-5ea7a6971c7b None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:11.101706 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906af55b-a0f0-48a7-b28b-5ea7a6971c7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:11.105776 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fdd3d3-98d3-426f-9fa6-2b579fd8fad2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:48:11.115050 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-99fdd3d3-98d3-426f-9fa6-2b579fd8fad2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:48:11.115050 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:48:11.115050 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:48:11.115050 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:48:11.115050 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:48:11.115050 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:48:11.115050 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:48:11.115050 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:48:11.115050 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:48:11.115050 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:48:11.115050 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:48:11.115050 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:48:11.115050 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:48:11.115050 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:48:11.115050 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:48:11.115050 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:48:11.116011 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:48:11.116011 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:48:11.116011 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:48:11.116011 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:48:11.116011 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:48:11.116011 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:48:11.116011 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:48:11.116011 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:48:11.116011 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:48:11.116011 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:48:11.116011 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:48:11.116011 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:48:11.116011 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:48:11.116011 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:48:11.116011 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:48:11.116011 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:48:11.116957 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:48:11.116957 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:48:11.116957 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:48:11.116957 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:48:11.116957 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:48:11.116957 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:48:11.116957 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:48:11.116957 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:48:11.116957 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:48:11.116957 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:48:11.116957 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:48:11.116957 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:48:11.116957 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 11:48:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:48:11.122053 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdd3d3-98d3-426f-9fa6-2b579fd8fad2 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:11.171303 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906af55b-a0f0-48a7-b28b-5ea7a6971c7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:11.172858 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906af55b-a0f0-48a7-b28b-5ea7a6971c7b None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:11.202553 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:11.221655 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdd3d3-98d3-426f-9fa6-2b579fd8fad2 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:11.257583 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610edaf-2528-402c-ae99-87a98eb64563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:11.258180 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610edaf-2528-402c-ae99-87a98eb64563 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:11.258457 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610edaf-2528-402c-ae99-87a98eb64563 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:11.258725 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610edaf-2528-402c-ae99-87a98eb64563 None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:11.259396 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610edaf-2528-402c-ae99-87a98eb64563 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:11.259702 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610edaf-2528-402c-ae99-87a98eb64563 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:11.261128 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610edaf-2528-402c-ae99-87a98eb64563 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:11.271529 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 8/15] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:48:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 21 11:48:11.272921 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 8/16] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:48:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:48:11.277066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906af55b-a0f0-48a7-b28b-5ea7a6971c7b None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:11.278125 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610edaf-2528-402c-ae99-87a98eb64563 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:11.280841 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:11.372966 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906af55b-a0f0-48a7-b28b-5ea7a6971c7b None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:11.378289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610edaf-2528-402c-ae99-87a98eb64563 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:11.406393 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24adb031-e465-43d6-a00c-5f0ce88fdee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:11.407228 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adb031-e465-43d6-a00c-5f0ce88fdee8 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:11.407507 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adb031-e465-43d6-a00c-5f0ce88fdee8 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:11.407773 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adb031-e465-43d6-a00c-5f0ce88fdee8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:11.412475 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d267f8-9771-4ad4-832c-ddf25212813f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:11.413091 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d267f8-9771-4ad4-832c-ddf25212813f None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:11.413563 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d267f8-9771-4ad4-832c-ddf25212813f None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:11.413662 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d267f8-9771-4ad4-832c-ddf25212813f None admin] PATH_INFO: `/v3/users/371d9f7c2d964f04b62c347e6b182e88` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:11.414741 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d267f8-9771-4ad4-832c-ddf25212813f None admin] RBAC: Authorizing `identity:get_user(user_id=371d9f7c2d964f04b62c347e6b182e88)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:11.416288 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d267f8-9771-4ad4-832c-ddf25212813f None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:11.418122 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 9/17] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:48:11 2022] GET /identity/v3/users/371d9f7c2d964f04b62c347e6b182e88 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:48:11.423458 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d267f8-9771-4ad4-832c-ddf25212813f None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:11.426320 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24adb031-e465-43d6-a00c-5f0ce88fdee8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:11.427796 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24adb031-e465-43d6-a00c-5f0ce88fdee8 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:11.437346 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:11.448303 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-24adb031-e465-43d6-a00c-5f0ce88fdee8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:48:11.448303 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:48:11.448303 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:48:11.448303 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:48:11.448303 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:48:11.448303 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:48:11.448303 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:48:11.448303 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:48:11.448303 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:48:11.448303 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:48:11.448303 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:48:11.448303 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:48:11.448303 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:48:11.448303 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:48:11.448303 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:48:11.448303 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:48:11.449323 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:48:11.449323 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:48:11.449323 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:48:11.449323 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:48:11.449323 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:48:11.449323 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:48:11.449323 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:48:11.449323 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:48:11.449323 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:48:11.449323 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:48:11.449323 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:48:11.449323 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:48:11.449323 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:48:11.449323 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:48:11.449323 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:48:11.449323 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:48:11.449323 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:48:11.450144 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:48:11.450144 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:48:11.450144 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:48:11.450144 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 9/18] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:48:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:48:11.455619 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24adb031-e465-43d6-a00c-5f0ce88fdee8 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:11.529841 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d267f8-9771-4ad4-832c-ddf25212813f None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:11.568283 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca652b13-2ae6-4ec4-b348-b701d57fb4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:11.568910 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca652b13-2ae6-4ec4-b348-b701d57fb4bd None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:11.569183 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca652b13-2ae6-4ec4-b348-b701d57fb4bd None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:11.569447 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca652b13-2ae6-4ec4-b348-b701d57fb4bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:11.570567 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca652b13-2ae6-4ec4-b348-b701d57fb4bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:11.572041 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca652b13-2ae6-4ec4-b348-b701d57fb4bd None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:11.573599 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 10/19] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:48:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:48:11.579424 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca652b13-2ae6-4ec4-b348-b701d57fb4bd None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:11.624208 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:11.662851 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:11.669884 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24adb031-e465-43d6-a00c-5f0ce88fdee8 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:11.686988 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca652b13-2ae6-4ec4-b348-b701d57fb4bd None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:11.705214 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3dd287-1aa2-4965-aac0-3c338890234f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:11.705816 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3dd287-1aa2-4965-aac0-3c338890234f None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:11.706094 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3dd287-1aa2-4965-aac0-3c338890234f None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:11.706363 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3dd287-1aa2-4965-aac0-3c338890234f None admin] PATH_INFO: `/v3/domains` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:11.707006 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3dd287-1aa2-4965-aac0-3c338890234f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:11.707334 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3dd287-1aa2-4965-aac0-3c338890234f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:11.708747 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3dd287-1aa2-4965-aac0-3c338890234f None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:11.720655 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d71c8-4f0b-436d-8cfc-3ec0bcdf0af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:11.721249 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d71c8-4f0b-436d-8cfc-3ec0bcdf0af1 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:11.721526 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d71c8-4f0b-436d-8cfc-3ec0bcdf0af1 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:11.721791 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d71c8-4f0b-436d-8cfc-3ec0bcdf0af1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:11.722501 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d71c8-4f0b-436d-8cfc-3ec0bcdf0af1 None admin] RBAC: Adding query filter params (role.id=d1f3d1431da145709a5e9b374f3b403d, scope.domain.id=default, user.id=371d9f7c2d964f04b62c347e6b182e88) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:11.722797 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d71c8-4f0b-436d-8cfc-3ec0bcdf0af1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:11.724242 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d71c8-4f0b-436d-8cfc-3ec0bcdf0af1 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:11.726247 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 10/20] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:48:11.730760 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 11/21] 10.222.0.27 () {56 vars in 1322 bytes} [Wed Sep 21 11:48:11 2022] GET /identity/v3/role_assignments?user.id=371d9f7c2d964f04b62c347e6b182e88&scope.domain.id=default&role.id=d1f3d1431da145709a5e9b374f3b403d => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:48:14.336743 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4bbdb9-bd5a-4cb5-bd45-6e0b45bae235 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:14.337769 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4bbdb9-bd5a-4cb5-bd45-6e0b45bae235 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:14.338268 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4bbdb9-bd5a-4cb5-bd45-6e0b45bae235 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:14.339779 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 11/22] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:14.345840 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d755bfe-46c4-4cf5-826c-f12b9f3b4e38 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:14.346704 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d755bfe-46c4-4cf5-826c-f12b9f3b4e38 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:14.347165 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d755bfe-46c4-4cf5-826c-f12b9f3b4e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:14.377025 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-7d755bfe-46c4-4cf5-826c-f12b9f3b4e38 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:14.378620 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-7d755bfe-46c4-4cf5-826c-f12b9f3b4e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:14.469468 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 12/23] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:48:14.881349 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356eef0-28e5-4b6b-bb43-8e9e8847066c None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:14.882040 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356eef0-28e5-4b6b-bb43-8e9e8847066c None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:14.882531 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356eef0-28e5-4b6b-bb43-8e9e8847066c None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:14.884079 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 12/24] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:14.900602 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c310122-8abd-48de-9821-789cb60b3e6f None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:14.901704 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c310122-8abd-48de-9821-789cb60b3e6f None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:14.902219 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c310122-8abd-48de-9821-789cb60b3e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:14.918990 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd77ff-d31d-4a3f-9fb1-12d0eaf4139a None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:14.919618 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd77ff-d31d-4a3f-9fb1-12d0eaf4139a None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:14.920140 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd77ff-d31d-4a3f-9fb1-12d0eaf4139a None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:14.921734 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 13/25] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 11:48:14.927154 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6abf0b-d4f7-4206-8934-33c9ba20f6a0 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:14.927731 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6abf0b-d4f7-4206-8934-33c9ba20f6a0 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:14.928242 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6abf0b-d4f7-4206-8934-33c9ba20f6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:14.932980 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-5c310122-8abd-48de-9821-789cb60b3e6f None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:14.934407 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-5c310122-8abd-48de-9821-789cb60b3e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:14.965019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-0e6abf0b-d4f7-4206-8934-33c9ba20f6a0 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:14.966569 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-0e6abf0b-d4f7-4206-8934-33c9ba20f6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:15.077536 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 13/26] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:48:15.089140 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c310122-8abd-48de-9821-789cb60b3e6f None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:15.095903 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:15.107915 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 14/27] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 21 11:48:15.245733 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c310122-8abd-48de-9821-789cb60b3e6f None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:15.288662 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382ed9a-1bfa-4e72-87b6-40993032c69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:15.289691 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382ed9a-1bfa-4e72-87b6-40993032c69c None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:15.290158 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382ed9a-1bfa-4e72-87b6-40993032c69c None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:15.290620 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382ed9a-1bfa-4e72-87b6-40993032c69c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:15.303027 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382ed9a-1bfa-4e72-87b6-40993032c69c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:48:15.308098 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-b382ed9a-1bfa-4e72-87b6-40993032c69c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:48:15.308098 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:48:15.308098 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:48:15.308098 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:48:15.308098 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:48:15.308098 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:48:15.308098 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:48:15.308098 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:48:15.308098 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:48:15.308098 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:48:15.308098 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:48:15.308098 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:48:15.308098 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:48:15.308098 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:48:15.308098 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:48:15.308098 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:48:15.308938 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:48:15.308938 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:48:15.308938 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:48:15.308938 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:48:15.308938 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:48:15.308938 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:48:15.308938 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:48:15.308938 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:48:15.308938 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:48:15.308938 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:48:15.308938 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:48:15.308938 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:48:15.308938 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:48:15.308938 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:48:15.308938 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:48:15.308938 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:48:15.310355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:48:15.310355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:48:15.310355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:48:15.310355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:48:15.310355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:48:15.310355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:48:15.310355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:48:15.310355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:48:15.310355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:48:15.310355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:48:15.310355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:48:15.310355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:48:15.317435 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 14/28] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 11:48:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:48:15.318994 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6abf0b-d4f7-4206-8934-33c9ba20f6a0 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:15.377984 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:15.464564 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6abf0b-d4f7-4206-8934-33c9ba20f6a0 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:15.499378 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382ed9a-1bfa-4e72-87b6-40993032c69c None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:15.523810 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd5919-435b-4186-a6d0-339aca1c4c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:15.524776 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd5919-435b-4186-a6d0-339aca1c4c46 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:15.525831 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd5919-435b-4186-a6d0-339aca1c4c46 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:15.526587 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd5919-435b-4186-a6d0-339aca1c4c46 None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:15.528728 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd5919-435b-4186-a6d0-339aca1c4c46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:15.529395 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd5919-435b-4186-a6d0-339aca1c4c46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:15.532171 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd5919-435b-4186-a6d0-339aca1c4c46 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:15.556571 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 15/29] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:48:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:15.563228 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd5919-435b-4186-a6d0-339aca1c4c46 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:15.623669 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:15.692490 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382ed9a-1bfa-4e72-87b6-40993032c69c None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:15.729854 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd5919-435b-4186-a6d0-339aca1c4c46 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:15.731815 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fe360-3987-4303-8cfb-dcc5113c036b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:15.732453 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fe360-3987-4303-8cfb-dcc5113c036b None admin] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:15.732766 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fe360-3987-4303-8cfb-dcc5113c036b None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:15.733040 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fe360-3987-4303-8cfb-dcc5113c036b None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:15.733737 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4fe360-3987-4303-8cfb-dcc5113c036b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:15.735119 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4fe360-3987-4303-8cfb-dcc5113c036b None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:15.740225 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:15.772290 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74982db-e9fa-4323-a352-2d0f5a976c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:15.772966 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74982db-e9fa-4323-a352-2d0f5a976c0a None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:15.773245 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74982db-e9fa-4323-a352-2d0f5a976c0a None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:15.773509 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74982db-e9fa-4323-a352-2d0f5a976c0a None admin] PATH_INFO: `/v3/users/371d9f7c2d964f04b62c347e6b182e88` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:15.774999 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74982db-e9fa-4323-a352-2d0f5a976c0a None admin] RBAC: Authorizing `identity:get_user(user_id=371d9f7c2d964f04b62c347e6b182e88)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:15.776719 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74982db-e9fa-4323-a352-2d0f5a976c0a None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:15.778724 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 16/30] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:48:15 2022] GET /identity/v3/users/371d9f7c2d964f04b62c347e6b182e88 => generated 247 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:15.779546 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74982db-e9fa-4323-a352-2d0f5a976c0a None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:15.899923 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74982db-e9fa-4323-a352-2d0f5a976c0a None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:15.901400 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 15/31] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Sep 21 11:48:15 2022] POST /identity/v3/roles => generated 219 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 11:48:15.902871 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9582c-518b-4cbf-a728-b2f6a7a65f99 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:15.903186 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9582c-518b-4cbf-a728-b2f6a7a65f99 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:15.903463 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9582c-518b-4cbf-a728-b2f6a7a65f99 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:15.904992 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 16/32] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:15.905718 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9582c-518b-4cbf-a728-b2f6a7a65f99 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:15.947952 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a26616-ca2e-432c-bdac-5f535dfe94e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:15.948651 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a26616-ca2e-432c-bdac-5f535dfe94e9 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:15.950721 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a26616-ca2e-432c-bdac-5f535dfe94e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:15.950993 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a26616-ca2e-432c-bdac-5f535dfe94e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:15.978314 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a26616-ca2e-432c-bdac-5f535dfe94e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:15.984854 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a26616-ca2e-432c-bdac-5f535dfe94e9 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:16.011315 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-45a26616-ca2e-432c-bdac-5f535dfe94e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:48:16.011315 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:48:16.011315 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:48:16.011315 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:48:16.011315 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:48:16.011315 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:48:16.011315 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:48:16.011315 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:48:16.011315 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:48:16.011315 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:48:16.011315 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:48:16.011315 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:48:16.011315 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:48:16.011315 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:48:16.011315 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:48:16.011315 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:48:16.012282 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:48:16.012282 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:48:16.012282 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:48:16.012282 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:48:16.012282 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:48:16.012282 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:48:16.012282 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:48:16.012282 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:48:16.012282 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:48:16.012282 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:48:16.012282 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:48:16.012282 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:48:16.012282 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:48:16.012282 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:48:16.012282 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:48:16.012282 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:48:16.012282 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:48:16.014225 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:48:16.014225 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:48:16.014225 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:48:16.014225 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 17/33] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:48:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:48:16.016816 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d25b7a-f73d-4f73-a6e4-392d1a036b5e None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:16.021302 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d25b7a-f73d-4f73-a6e4-392d1a036b5e None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:16.021653 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d25b7a-f73d-4f73-a6e4-392d1a036b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:16.061303 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-00d25b7a-f73d-4f73-a6e4-392d1a036b5e None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:16.062441 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-00d25b7a-f73d-4f73-a6e4-392d1a036b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:16.113167 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:16.122703 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9582c-518b-4cbf-a728-b2f6a7a65f99 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:16.173886 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:16.193263 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8f8d0-0065-4773-8f50-a6c3bf041c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:16.193898 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8f8d0-0065-4773-8f50-a6c3bf041c3a None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:16.194177 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8f8d0-0065-4773-8f50-a6c3bf041c3a None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:16.194446 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8f8d0-0065-4773-8f50-a6c3bf041c3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:16.196930 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8f8d0-0065-4773-8f50-a6c3bf041c3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:16.198013 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8f8d0-0065-4773-8f50-a6c3bf041c3a None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:16.199794 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 17/34] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:48:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:16.202023 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8f8d0-0065-4773-8f50-a6c3bf041c3a None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:16.204430 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 18/35] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:48:16.213017 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d25b7a-f73d-4f73-a6e4-392d1a036b5e None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:16.380609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8f8d0-0065-4773-8f50-a6c3bf041c3a None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:16.412550 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d25b7a-f73d-4f73-a6e4-392d1a036b5e None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:16.425026 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9c3f0-43cd-4a80-a50a-7b3fb7972497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:16.425853 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9c3f0-43cd-4a80-a50a-7b3fb7972497 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:16.426366 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9c3f0-43cd-4a80-a50a-7b3fb7972497 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:16.426782 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9c3f0-43cd-4a80-a50a-7b3fb7972497 None admin] PATH_INFO: `/v3/domains` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:16.427591 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9c3f0-43cd-4a80-a50a-7b3fb7972497 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:16.428068 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9c3f0-43cd-4a80-a50a-7b3fb7972497 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:16.430611 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9c3f0-43cd-4a80-a50a-7b3fb7972497 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:16.456090 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 18/36] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:16.457705 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f04bb-2d2e-435c-8bc8-bcc82c574b55 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:16.458115 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f04bb-2d2e-435c-8bc8-bcc82c574b55 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:16.458539 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f04bb-2d2e-435c-8bc8-bcc82c574b55 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:16.459965 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 19/37] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:16.460755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c2e8d-ebfb-4a57-8344-5296a483dc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:16.461435 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c2e8d-ebfb-4a57-8344-5296a483dc81 None admin] REQUEST_METHOD: `PUT` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:16.461717 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c2e8d-ebfb-4a57-8344-5296a483dc81 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:16.462000 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c2e8d-ebfb-4a57-8344-5296a483dc81 None admin] PATH_INFO: `/v3/domains/default/users/371d9f7c2d964f04b62c347e6b182e88/roles/d1f3d1431da145709a5e9b374f3b403d` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:16.463805 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f04bb-2d2e-435c-8bc8-bcc82c574b55 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:16.468977 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c2e8d-ebfb-4a57-8344-5296a483dc81 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=371d9f7c2d964f04b62c347e6b182e88, role_id=d1f3d1431da145709a5e9b374f3b403d)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:16.470470 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c2e8d-ebfb-4a57-8344-5296a483dc81 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:16.530301 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:16.585719 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f04bb-2d2e-435c-8bc8-bcc82c574b55 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:16.604281 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 19/38] 10.222.0.27 () {58 vars in 1361 bytes} [Wed Sep 21 11:48:16 2022] PUT /identity/v3/domains/default/users/371d9f7c2d964f04b62c347e6b182e88/roles/d1f3d1431da145709a5e9b374f3b403d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 11:48:16.604281 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d537e-e2de-4372-90c5-4947800087e7 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:16.604281 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d537e-e2de-4372-90c5-4947800087e7 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:16.604281 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d537e-e2de-4372-90c5-4947800087e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:16.627235 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-726d537e-e2de-4372-90c5-4947800087e7 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:16.628834 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-726d537e-e2de-4372-90c5-4947800087e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:16.630976 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fddf8e-6e3f-4a1c-b0e6-81c28ca5e49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:16.631528 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fddf8e-6e3f-4a1c-b0e6-81c28ca5e49d None admin] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:16.631809 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fddf8e-6e3f-4a1c-b0e6-81c28ca5e49d None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:16.632112 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fddf8e-6e3f-4a1c-b0e6-81c28ca5e49d None admin] PATH_INFO: `/v3/projects` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:16.632800 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fddf8e-6e3f-4a1c-b0e6-81c28ca5e49d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:16.634281 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fddf8e-6e3f-4a1c-b0e6-81c28ca5e49d None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:16.648757 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:16.670985 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 20/39] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 21 11:48:16 2022] POST /identity/v3/projects => generated 301 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 11:48:16.675134 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb42c2-ce93-4958-a223-c2c1e700e573 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:16.675858 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb42c2-ce93-4958-a223-c2c1e700e573 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:16.676598 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb42c2-ce93-4958-a223-c2c1e700e573 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:16.687086 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 21/40] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:16.687086 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb42c2-ce93-4958-a223-c2c1e700e573 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:16.727623 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 20/41] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:48:16.737649 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afb670-848d-476d-9e69-d63c0cb73c38 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:16.738037 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afb670-848d-476d-9e69-d63c0cb73c38 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:16.738412 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afb670-848d-476d-9e69-d63c0cb73c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:16.785230 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-54afb670-848d-476d-9e69-d63c0cb73c38 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:16.786679 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-54afb670-848d-476d-9e69-d63c0cb73c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:16.843196 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb42c2-ce93-4958-a223-c2c1e700e573 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:16.846454 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:16.902925 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4589fc6-d325-48dd-9d14-1ed9d05413a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:16.903691 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4589fc6-d325-48dd-9d14-1ed9d05413a9 None admin] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:16.904130 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4589fc6-d325-48dd-9d14-1ed9d05413a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:16.904415 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4589fc6-d325-48dd-9d14-1ed9d05413a9 None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:16.905362 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4589fc6-d325-48dd-9d14-1ed9d05413a9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:16.907597 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4589fc6-d325-48dd-9d14-1ed9d05413a9 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:16.919924 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 21/42] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:48:16.933576 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 22/43] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Sep 21 11:48:16 2022] POST /identity/v3/roles => generated 225 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 11:48:17.132243 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afb670-848d-476d-9e69-d63c0cb73c38 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:17.222218 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:17.246836 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afb670-848d-476d-9e69-d63c0cb73c38 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:17.286107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18abcac-5c2b-4532-b125-6dec3874b7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:17.287739 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4589fc6-d325-48dd-9d14-1ed9d05413a9 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:17.288135 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18abcac-5c2b-4532-b125-6dec3874b7d4 None admin] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:17.288676 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18abcac-5c2b-4532-b125-6dec3874b7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:17.289102 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18abcac-5c2b-4532-b125-6dec3874b7d4 None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:17.289940 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18abcac-5c2b-4532-b125-6dec3874b7d4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:17.292154 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18abcac-5c2b-4532-b125-6dec3874b7d4 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:17.313246 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 22/44] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Sep 21 11:48:17 2022] POST /identity/v3/roles => generated 223 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 11:48:17.401250 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4589fc6-d325-48dd-9d14-1ed9d05413a9 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:17.438450 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a581e6e-8853-4f31-88ec-356a173628aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:17.439159 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a581e6e-8853-4f31-88ec-356a173628aa None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:17.439437 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a581e6e-8853-4f31-88ec-356a173628aa None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:17.439705 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a581e6e-8853-4f31-88ec-356a173628aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:17.440966 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a581e6e-8853-4f31-88ec-356a173628aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:17.442512 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a581e6e-8853-4f31-88ec-356a173628aa None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:17.444498 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 23/45] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:48:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:48:17.450529 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18abcac-5c2b-4532-b125-6dec3874b7d4 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:17.564751 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18abcac-5c2b-4532-b125-6dec3874b7d4 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:17.605359 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21122641-8793-42cb-a733-3c2e26ab02f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:17.605971 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21122641-8793-42cb-a733-3c2e26ab02f9 None admin] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:17.606283 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21122641-8793-42cb-a733-3c2e26ab02f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:17.606552 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21122641-8793-42cb-a733-3c2e26ab02f9 None admin] PATH_INFO: `/v3/projects` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:17.607197 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21122641-8793-42cb-a733-3c2e26ab02f9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:17.608691 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21122641-8793-42cb-a733-3c2e26ab02f9 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:17.618696 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:17.636732 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 23/46] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 21 11:48:17 2022] POST /identity/v3/projects => generated 312 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 11:48:19.123023 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b2a9b-b284-4022-a5c6-ef91fd4d92b0 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:19.123548 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b2a9b-b284-4022-a5c6-ef91fd4d92b0 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:19.123548 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b2a9b-b284-4022-a5c6-ef91fd4d92b0 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:19.124988 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 24/47] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:19.130178 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c6f67-f2d4-4f2a-bee8-7ea376df3848 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:19.130596 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c6f67-f2d4-4f2a-bee8-7ea376df3848 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:19.130921 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c6f67-f2d4-4f2a-bee8-7ea376df3848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:19.149215 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-cb9c6f67-f2d4-4f2a-bee8-7ea376df3848 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:19.150432 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-cb9c6f67-f2d4-4f2a-bee8-7ea376df3848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:19.221156 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 24/48] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:48:19.546253 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b2a9b-b284-4022-a5c6-ef91fd4d92b0 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:19.583407 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:19.658693 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b2a9b-b284-4022-a5c6-ef91fd4d92b0 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:19.696491 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25e8d2-3298-475a-b88a-814600885cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:19.697107 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25e8d2-3298-475a-b88a-814600885cbe None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:19.697385 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25e8d2-3298-475a-b88a-814600885cbe None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:19.697652 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25e8d2-3298-475a-b88a-814600885cbe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:19.708113 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25e8d2-3298-475a-b88a-814600885cbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:48:19.712895 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-ee25e8d2-3298-475a-b88a-814600885cbe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:48:19.712895 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:48:19.712895 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:48:19.712895 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:48:19.712895 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:48:19.712895 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:48:19.712895 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:48:19.712895 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:48:19.712895 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:48:19.712895 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:48:19.712895 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:48:19.712895 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:48:19.712895 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:48:19.712895 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:48:19.712895 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:48:19.712895 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:48:19.714005 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:48:19.714005 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:48:19.714005 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:48:19.714005 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:48:19.714005 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:48:19.714005 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:48:19.714005 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:48:19.714005 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:48:19.714005 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:48:19.714005 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:48:19.714005 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:48:19.714005 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:48:19.714005 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:48:19.714005 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:48:19.714005 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:48:19.714005 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:48:19.714794 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:48:19.714794 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:48:19.714794 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:48:19.714794 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:48:19.714794 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:48:19.714794 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:48:19.714794 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:48:19.714794 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:48:19.714794 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:48:19.714794 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:48:19.714794 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:48:19.714794 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:48:19.714794 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 25/49] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 11:48:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:48:19.719746 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c6f67-f2d4-4f2a-bee8-7ea376df3848 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:19.817589 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c6f67-f2d4-4f2a-bee8-7ea376df3848 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:19.838019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:19.852689 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbde29c-6041-4726-82f5-b2381929376b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:19.853287 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbde29c-6041-4726-82f5-b2381929376b None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:19.853564 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbde29c-6041-4726-82f5-b2381929376b None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:19.853831 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbde29c-6041-4726-82f5-b2381929376b None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:19.854484 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbde29c-6041-4726-82f5-b2381929376b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:19.854780 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbde29c-6041-4726-82f5-b2381929376b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:19.856770 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbde29c-6041-4726-82f5-b2381929376b None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:19.864789 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 25/50] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:48:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:19.870545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25e8d2-3298-475a-b88a-814600885cbe None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:19.961851 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:19.971429 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25e8d2-3298-475a-b88a-814600885cbe None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:20.003706 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea462e87-981b-46d1-8749-ee95dcab1d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:20.004361 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea462e87-981b-46d1-8749-ee95dcab1d3c None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:20.004641 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea462e87-981b-46d1-8749-ee95dcab1d3c None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:20.004912 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea462e87-981b-46d1-8749-ee95dcab1d3c None admin] PATH_INFO: `/v3/users/371d9f7c2d964f04b62c347e6b182e88` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:20.006032 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea462e87-981b-46d1-8749-ee95dcab1d3c None admin] RBAC: Authorizing `identity:get_user(user_id=371d9f7c2d964f04b62c347e6b182e88)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:20.007490 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea462e87-981b-46d1-8749-ee95dcab1d3c None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:20.009085 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 26/51] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:48:19 2022] GET /identity/v3/users/371d9f7c2d964f04b62c347e6b182e88 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:20.014549 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbde29c-6041-4726-82f5-b2381929376b None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:20.038743 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc52b7-50a0-4c51-b438-8f29fdf527e3 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:20.039025 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc52b7-50a0-4c51-b438-8f29fdf527e3 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:20.039331 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc52b7-50a0-4c51-b438-8f29fdf527e3 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:20.040691 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 27/52] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 11:48:20.046243 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514cfec-03c9-4c7b-a36c-6e6e45698a60 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:20.046521 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514cfec-03c9-4c7b-a36c-6e6e45698a60 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:20.046923 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514cfec-03c9-4c7b-a36c-6e6e45698a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:20.065505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-a514cfec-03c9-4c7b-a36c-6e6e45698a60 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:20.067003 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-a514cfec-03c9-4c7b-a36c-6e6e45698a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:20.116708 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbde29c-6041-4726-82f5-b2381929376b None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:20.134630 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 28/53] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 11:48:20.149067 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33942467-43ab-4086-ae5d-9f636e38743a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:20.149697 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33942467-43ab-4086-ae5d-9f636e38743a None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:20.149975 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33942467-43ab-4086-ae5d-9f636e38743a None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:20.150247 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33942467-43ab-4086-ae5d-9f636e38743a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:20.151403 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33942467-43ab-4086-ae5d-9f636e38743a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:20.152882 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33942467-43ab-4086-ae5d-9f636e38743a None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:20.154937 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 26/54] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:48:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:20.160634 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514cfec-03c9-4c7b-a36c-6e6e45698a60 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:20.248101 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:20.257640 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514cfec-03c9-4c7b-a36c-6e6e45698a60 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:20.290247 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb420474-18e2-442f-a64b-b7adc127d4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:20.290836 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb420474-18e2-442f-a64b-b7adc127d4eb None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:20.291108 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb420474-18e2-442f-a64b-b7adc127d4eb None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:20.291380 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb420474-18e2-442f-a64b-b7adc127d4eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:20.292382 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb420474-18e2-442f-a64b-b7adc127d4eb None admin] RBAC: Adding query filter params (role.id=d1f3d1431da145709a5e9b374f3b403d, scope.domain.id=default, user.id=371d9f7c2d964f04b62c347e6b182e88) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:20.292686 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb420474-18e2-442f-a64b-b7adc127d4eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:20.294734 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb420474-18e2-442f-a64b-b7adc127d4eb None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:20.300237 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 29/55] 10.222.0.27 () {56 vars in 1322 bytes} [Wed Sep 21 11:48:20 2022] GET /identity/v3/role_assignments?user.id=371d9f7c2d964f04b62c347e6b182e88&scope.domain.id=default&role.id=d1f3d1431da145709a5e9b374f3b403d => generated 530 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:20.457920 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33942467-43ab-4086-ae5d-9f636e38743a None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:20.510296 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:20.561833 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33942467-43ab-4086-ae5d-9f636e38743a None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:20.594120 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8ad31-e9f9-440f-a459-c4a587b42f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:20.594750 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8ad31-e9f9-440f-a459-c4a587b42f34 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:20.595028 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8ad31-e9f9-440f-a459-c4a587b42f34 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:20.595304 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8ad31-e9f9-440f-a459-c4a587b42f34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:20.596501 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8ad31-e9f9-440f-a459-c4a587b42f34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:20.597974 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8ad31-e9f9-440f-a459-c4a587b42f34 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:20.599584 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 27/56] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:48:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:20.605099 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb420474-18e2-442f-a64b-b7adc127d4eb None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:20.702250 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb420474-18e2-442f-a64b-b7adc127d4eb None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:20.735065 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532438a8-f850-4dec-9811-6485253cb62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:20.735597 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532438a8-f850-4dec-9811-6485253cb62c None admin] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:20.735874 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532438a8-f850-4dec-9811-6485253cb62c None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:20.736184 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532438a8-f850-4dec-9811-6485253cb62c None admin] PATH_INFO: `/v3/projects` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:20.736819 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532438a8-f850-4dec-9811-6485253cb62c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:20.738253 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532438a8-f850-4dec-9811-6485253cb62c None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:20.763442 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 30/57] 10.222.0.27 () {60 vars in 1140 bytes} [Wed Sep 21 11:48:20 2022] POST /identity/v3/projects => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 11:48:23.098536 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f41cf-31b5-4ef4-989c-51f78d3c0c83 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:23.099054 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f41cf-31b5-4ef4-989c-51f78d3c0c83 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:23.099054 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f41cf-31b5-4ef4-989c-51f78d3c0c83 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:23.100444 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 28/58] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:23.105533 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2879b5-684b-4231-87f0-7b3102d74106 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:23.105920 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2879b5-684b-4231-87f0-7b3102d74106 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:23.106114 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2879b5-684b-4231-87f0-7b3102d74106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:23.119389 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:23.125982 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-cd2879b5-684b-4231-87f0-7b3102d74106 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:23.127154 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-cd2879b5-684b-4231-87f0-7b3102d74106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:23.189990 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 31/59] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:48:23.507296 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f41cf-31b5-4ef4-989c-51f78d3c0c83 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:23.611778 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f41cf-31b5-4ef4-989c-51f78d3c0c83 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:23.627880 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:23.644664 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e1e29-15b8-4b89-b7b0-7dbddbeb96e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:23.645288 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e1e29-15b8-4b89-b7b0-7dbddbeb96e0 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:23.645570 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e1e29-15b8-4b89-b7b0-7dbddbeb96e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:23.645847 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e1e29-15b8-4b89-b7b0-7dbddbeb96e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:23.646960 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e1e29-15b8-4b89-b7b0-7dbddbeb96e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:23.648446 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e1e29-15b8-4b89-b7b0-7dbddbeb96e0 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:23.649998 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 29/60] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:48:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:23.656052 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2879b5-684b-4231-87f0-7b3102d74106 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:23.753264 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2879b5-684b-4231-87f0-7b3102d74106 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:23.785960 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c602d-4996-4ecc-b98e-6faee77de0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:23.786495 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c602d-4996-4ecc-b98e-6faee77de0d8 None admin] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:23.786776 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c602d-4996-4ecc-b98e-6faee77de0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:23.787046 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c602d-4996-4ecc-b98e-6faee77de0d8 None admin] PATH_INFO: `/v3/users` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:23.787697 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c602d-4996-4ecc-b98e-6faee77de0d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:23.789196 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c602d-4996-4ecc-b98e-6faee77de0d8 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:23.801204 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:23.816653 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 32/61] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 21 11:48:23 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 11:48:27.591746 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662cc12-57a6-4adf-af2d-6047be4c1858 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:27.592638 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662cc12-57a6-4adf-af2d-6047be4c1858 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:27.593179 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662cc12-57a6-4adf-af2d-6047be4c1858 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:27.595472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 30/62] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:27.601097 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ac36d-a5a0-48ab-82fb-885fa307d3b8 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:27.602911 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce38c9-d389-4745-8d80-3b9470cfef83 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:27.603393 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce38c9-d389-4745-8d80-3b9470cfef83 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:27.603854 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce38c9-d389-4745-8d80-3b9470cfef83 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:27.605371 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 31/63] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 11:48:27.606465 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ac36d-a5a0-48ab-82fb-885fa307d3b8 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:27.606961 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ac36d-a5a0-48ab-82fb-885fa307d3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:27.612721 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57004b84-430a-4178-96c3-0b987871a77d None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:27.613010 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57004b84-430a-4178-96c3-0b987871a77d None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:27.613291 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57004b84-430a-4178-96c3-0b987871a77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:27.638557 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-57004b84-430a-4178-96c3-0b987871a77d None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:27.639887 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-57004b84-430a-4178-96c3-0b987871a77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:27.643030 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-2b0ac36d-a5a0-48ab-82fb-885fa307d3b8 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:27.644225 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-2b0ac36d-a5a0-48ab-82fb-885fa307d3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:27.772943 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 33/64] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:48:27.784345 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 32/65] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:48:27.842155 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1905faf-0cd3-4e5d-a69d-6cf3ec7c44a4 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:27.842443 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1905faf-0cd3-4e5d-a69d-6cf3ec7c44a4 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:27.842636 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1905faf-0cd3-4e5d-a69d-6cf3ec7c44a4 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:27.844259 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 34/66] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:27.849001 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c3b18-4a0d-43f0-b576-9f38793254b7 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:27.849289 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c3b18-4a0d-43f0-b576-9f38793254b7 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:27.849566 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c3b18-4a0d-43f0-b576-9f38793254b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:27.875900 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-d71c3b18-4a0d-43f0-b576-9f38793254b7 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:27.877113 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-d71c3b18-4a0d-43f0-b576-9f38793254b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:27.965405 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 33/67] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 11:48:28.039301 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5f138-bb23-4f4d-a57f-043964c6f02b None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:28.039614 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5f138-bb23-4f4d-a57f-043964c6f02b None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:28.039856 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5f138-bb23-4f4d-a57f-043964c6f02b None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:28.041684 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 35/68] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:28.047455 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883ebe4-3d33-4ffa-8e6b-23cb5ab88478 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:28.047742 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883ebe4-3d33-4ffa-8e6b-23cb5ab88478 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:28.048018 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883ebe4-3d33-4ffa-8e6b-23cb5ab88478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:28.072259 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-e883ebe4-3d33-4ffa-8e6b-23cb5ab88478 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:28.073435 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-e883ebe4-3d33-4ffa-8e6b-23cb5ab88478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:28.127743 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:28.140965 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedef79-2536-47ac-8233-7c15f375b12d None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:28.141535 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedef79-2536-47ac-8233-7c15f375b12d None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:28.142015 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedef79-2536-47ac-8233-7c15f375b12d None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:28.143572 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 36/69] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:28.148470 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbeec4e-5a1c-4c4d-a8fe-f0b166582e40 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:28.148972 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbeec4e-5a1c-4c4d-a8fe-f0b166582e40 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:28.149461 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbeec4e-5a1c-4c4d-a8fe-f0b166582e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:28.158671 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 34/70] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:48:28.180939 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-1bbeec4e-5a1c-4c4d-a8fe-f0b166582e40 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:28.182397 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-1bbeec4e-5a1c-4c4d-a8fe-f0b166582e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:28.197486 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883ebe4-3d33-4ffa-8e6b-23cb5ab88478 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:28.306532 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883ebe4-3d33-4ffa-8e6b-23cb5ab88478 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:28.321718 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 37/71] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 11:48:28.324137 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbeec4e-5a1c-4c4d-a8fe-f0b166582e40 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:28.382092 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:28.408697 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf0feb-d4e4-40a5-8dda-60160634662d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:28.409344 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf0feb-d4e4-40a5-8dda-60160634662d None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:28.409626 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf0feb-d4e4-40a5-8dda-60160634662d None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:28.409900 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf0feb-d4e4-40a5-8dda-60160634662d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:28.430184 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf0feb-d4e4-40a5-8dda-60160634662d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:48:28.434806 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbeec4e-5a1c-4c4d-a8fe-f0b166582e40 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:28.436604 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-eacf0feb-d4e4-40a5-8dda-60160634662d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:48:28.436604 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:48:28.436604 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:48:28.436604 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:48:28.436604 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:48:28.436604 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:48:28.436604 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:48:28.436604 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:48:28.436604 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:48:28.436604 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:48:28.436604 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:48:28.436604 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:48:28.436604 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:48:28.436604 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:48:28.436604 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:48:28.436604 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:48:28.437474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:48:28.437474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:48:28.437474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:48:28.437474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:48:28.437474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:48:28.437474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:48:28.437474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:48:28.437474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:48:28.437474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:48:28.437474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:48:28.437474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:48:28.437474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:48:28.437474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:48:28.437474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:48:28.437474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:48:28.437474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:48:28.438267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:48:28.438267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:48:28.438267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:48:28.438267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:48:28.438267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:48:28.438267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:48:28.438267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:48:28.438267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:48:28.438267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:48:28.438267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:48:28.438267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:48:28.438267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:48:28.438267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 35/72] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 11:48:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:48:28.438925 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf0feb-d4e4-40a5-8dda-60160634662d None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:28.475058 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:28.476389 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bc571-c916-46b5-9c24-362cd0108ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:28.477303 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bc571-c916-46b5-9c24-362cd0108ada None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:28.477754 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bc571-c916-46b5-9c24-362cd0108ada None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:28.478222 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bc571-c916-46b5-9c24-362cd0108ada None admin] PATH_INFO: `/v3/roles/member` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:28.490604 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65bc571-c916-46b5-9c24-362cd0108ada None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:48:28.495883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-e65bc571-c916-46b5-9c24-362cd0108ada None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:48:28.495883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:48:28.495883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:48:28.495883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:48:28.495883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:48:28.495883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:48:28.495883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:48:28.495883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:48:28.495883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:48:28.495883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:48:28.495883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:48:28.495883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:48:28.495883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:48:28.495883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:48:28.495883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:48:28.495883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:48:28.496806 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:48:28.496806 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:48:28.496806 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:48:28.496806 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:48:28.496806 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:48:28.496806 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:48:28.496806 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:48:28.496806 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:48:28.496806 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:48:28.496806 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:48:28.496806 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:48:28.496806 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:48:28.496806 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:48:28.496806 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:48:28.496806 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:48:28.496806 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:48:28.497593 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:48:28.497593 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:48:28.497593 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:48:28.497593 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:48:28.497593 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:48:28.497593 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:48:28.497593 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:48:28.497593 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:48:28.497593 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:48:28.497593 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:48:28.497593 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:48:28.497593 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:48:28.500027 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 38/73] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:48:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:48:28.505581 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bc571-c916-46b5-9c24-362cd0108ada None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:28.548932 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf0feb-d4e4-40a5-8dda-60160634662d None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:28.587169 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13348d-097c-4b4a-9555-b14f404547b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:28.587810 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13348d-097c-4b4a-9555-b14f404547b6 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:28.588125 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13348d-097c-4b4a-9555-b14f404547b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:28.588398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13348d-097c-4b4a-9555-b14f404547b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:28.601342 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13348d-097c-4b4a-9555-b14f404547b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:48:28.608058 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-1c13348d-097c-4b4a-9555-b14f404547b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 11:48:28.608058 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:48:28.608058 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:48:28.608058 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:48:28.608058 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:48:28.608058 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:48:28.608058 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:48:28.608058 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:48:28.608058 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:48:28.608058 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:48:28.608058 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:48:28.608058 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:48:28.608058 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:48:28.608058 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:48:28.608058 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:48:28.608058 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:48:28.608914 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:48:28.608914 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:48:28.608914 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:48:28.608914 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:48:28.608914 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:48:28.608914 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:48:28.608914 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:48:28.608914 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:48:28.608914 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:48:28.608914 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:48:28.608914 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:48:28.608914 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:48:28.608914 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:48:28.608914 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:48:28.608914 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:48:28.608914 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:48:28.609700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:48:28.609700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:48:28.609700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:48:28.609700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:48:28.609700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:48:28.609700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:48:28.609700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:48:28.609700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:48:28.609700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:48:28.609700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:48:28.609700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 11:48:28.609700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:48:28.609700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 36/74] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 11:48:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:48:28.610868 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13348d-097c-4b4a-9555-b14f404547b6 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:28.622690 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bc571-c916-46b5-9c24-362cd0108ada None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:28.639125 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:28.661590 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b5eaa-dc72-469e-9af2-27a22cea18b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:28.662015 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b5eaa-dc72-469e-9af2-27a22cea18b8 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:28.662293 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b5eaa-dc72-469e-9af2-27a22cea18b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:28.662564 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b5eaa-dc72-469e-9af2-27a22cea18b8 None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:28.663225 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b5eaa-dc72-469e-9af2-27a22cea18b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:28.663527 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b5eaa-dc72-469e-9af2-27a22cea18b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:28.665200 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b5eaa-dc72-469e-9af2-27a22cea18b8 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:28.678584 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 39/75] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:48:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:28.678584 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b5eaa-dc72-469e-9af2-27a22cea18b8 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:28.716240 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:28.722570 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13348d-097c-4b4a-9555-b14f404547b6 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:28.755055 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270de5c-1120-40cb-9590-543cf803b652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:28.755674 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270de5c-1120-40cb-9590-543cf803b652 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:28.755949 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270de5c-1120-40cb-9590-543cf803b652 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:28.756237 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270de5c-1120-40cb-9590-543cf803b652 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:28.767765 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270de5c-1120-40cb-9590-543cf803b652 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:48:28.772508 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-b270de5c-1120-40cb-9590-543cf803b652 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:48:28.772508 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:48:28.772508 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:48:28.772508 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:48:28.772508 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:48:28.772508 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:48:28.772508 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:48:28.772508 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:48:28.772508 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:48:28.772508 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:48:28.772508 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:48:28.772508 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:48:28.772508 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:48:28.772508 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:48:28.772508 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:48:28.772508 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:48:28.773338 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:48:28.773338 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:48:28.773338 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:48:28.773338 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:48:28.773338 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:48:28.773338 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:48:28.773338 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:48:28.773338 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:48:28.773338 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:48:28.773338 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:48:28.773338 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:48:28.773338 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:48:28.773338 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:48:28.773338 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:48:28.773338 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:48:28.773338 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:48:28.774161 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:48:28.774161 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:48:28.774161 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:48:28.774161 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:48:28.774161 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:48:28.774161 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:48:28.774161 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:48:28.774161 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:48:28.774161 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:48:28.774161 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:48:28.774161 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:48:28.774161 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:48:28.774161 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 37/76] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:48:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:48:28.774799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270de5c-1120-40cb-9590-543cf803b652 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:28.781403 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b5eaa-dc72-469e-9af2-27a22cea18b8 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:28.818821 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536a267-11e5-43ee-a181-5a1212ddb21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:28.819597 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536a267-11e5-43ee-a181-5a1212ddb21a None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:28.819973 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536a267-11e5-43ee-a181-5a1212ddb21a None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:28.820369 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536a267-11e5-43ee-a181-5a1212ddb21a None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:28.821318 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536a267-11e5-43ee-a181-5a1212ddb21a None admin] RBAC: Adding query filter params (name=member) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:28.821748 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536a267-11e5-43ee-a181-5a1212ddb21a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:28.823812 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536a267-11e5-43ee-a181-5a1212ddb21a None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:28.838660 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 40/77] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 11:48:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:28.838660 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536a267-11e5-43ee-a181-5a1212ddb21a None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:28.873575 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:28.873947 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270de5c-1120-40cb-9590-543cf803b652 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:28.907469 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94ea95-b77e-4270-abfe-fc82880d549b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:28.908133 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94ea95-b77e-4270-abfe-fc82880d549b None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:28.908467 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94ea95-b77e-4270-abfe-fc82880d549b None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:28.908766 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94ea95-b77e-4270-abfe-fc82880d549b None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:28.909425 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94ea95-b77e-4270-abfe-fc82880d549b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:28.909725 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94ea95-b77e-4270-abfe-fc82880d549b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:28.911111 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94ea95-b77e-4270-abfe-fc82880d549b None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:28.919255 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 38/78] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:48:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:28.920146 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94ea95-b77e-4270-abfe-fc82880d549b None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:28.939954 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:28.943120 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536a267-11e5-43ee-a181-5a1212ddb21a None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:28.976881 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687777e-9ff4-4262-8b99-2050f579e93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:28.977494 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687777e-9ff4-4262-8b99-2050f579e93d None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:28.977769 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687777e-9ff4-4262-8b99-2050f579e93d None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:28.978037 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687777e-9ff4-4262-8b99-2050f579e93d None admin] PATH_INFO: `/v3/users/371d9f7c2d964f04b62c347e6b182e88` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:28.979147 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687777e-9ff4-4262-8b99-2050f579e93d None admin] RBAC: Authorizing `identity:get_user(user_id=371d9f7c2d964f04b62c347e6b182e88)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:28.980635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687777e-9ff4-4262-8b99-2050f579e93d None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:28.982242 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 41/79] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:48:28 2022] GET /identity/v3/users/371d9f7c2d964f04b62c347e6b182e88 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:28.984860 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687777e-9ff4-4262-8b99-2050f579e93d None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:29.020359 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94ea95-b77e-4270-abfe-fc82880d549b None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:29.052288 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a855c1-0592-47d9-98f3-af154edc2d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:29.052900 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a855c1-0592-47d9-98f3-af154edc2d9d None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:29.053176 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a855c1-0592-47d9-98f3-af154edc2d9d None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:29.053443 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a855c1-0592-47d9-98f3-af154edc2d9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:29.054568 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a855c1-0592-47d9-98f3-af154edc2d9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:29.056023 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a855c1-0592-47d9-98f3-af154edc2d9d None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:29.057557 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 39/80] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:48:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:29.059942 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a855c1-0592-47d9-98f3-af154edc2d9d None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:29.084059 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687777e-9ff4-4262-8b99-2050f579e93d None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:29.086770 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:29.117027 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d99ef-be92-4ed7-8dad-91fe8ed321cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:29.117628 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d99ef-be92-4ed7-8dad-91fe8ed321cf None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:29.117905 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d99ef-be92-4ed7-8dad-91fe8ed321cf None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:29.118176 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d99ef-be92-4ed7-8dad-91fe8ed321cf None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:29.118827 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d99ef-be92-4ed7-8dad-91fe8ed321cf None admin] RBAC: Adding query filter params (name=member) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:29.119125 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d99ef-be92-4ed7-8dad-91fe8ed321cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:29.120532 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d99ef-be92-4ed7-8dad-91fe8ed321cf None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:29.128837 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 42/81] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 11:48:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:29.133878 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d99ef-be92-4ed7-8dad-91fe8ed321cf None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:29.144726 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:29.160715 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a855c1-0592-47d9-98f3-af154edc2d9d None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:29.196442 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340d539-1df8-4aa6-b104-f7042c629115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:29.197134 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340d539-1df8-4aa6-b104-f7042c629115 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:29.197247 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340d539-1df8-4aa6-b104-f7042c629115 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:29.197518 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340d539-1df8-4aa6-b104-f7042c629115 None admin] PATH_INFO: `/v3/users/955fb91fe1bc4272b566b64ee4527121` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:29.213640 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340d539-1df8-4aa6-b104-f7042c629115 None admin] RBAC: Authorizing `identity:get_user(user_id=955fb91fe1bc4272b566b64ee4527121)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:29.215512 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340d539-1df8-4aa6-b104-f7042c629115 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:29.217154 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 40/82] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:48:29 2022] GET /identity/v3/users/955fb91fe1bc4272b566b64ee4527121 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:29.217912 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340d539-1df8-4aa6-b104-f7042c629115 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:29.231292 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d99ef-be92-4ed7-8dad-91fe8ed321cf None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:29.265952 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a45d99-93d0-4691-a8e7-28430c572b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:29.266599 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a45d99-93d0-4691-a8e7-28430c572b46 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:29.266878 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a45d99-93d0-4691-a8e7-28430c572b46 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:29.267145 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a45d99-93d0-4691-a8e7-28430c572b46 None admin] PATH_INFO: `/v3/users/955fb91fe1bc4272b566b64ee4527121` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:29.268297 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a45d99-93d0-4691-a8e7-28430c572b46 None admin] RBAC: Authorizing `identity:get_user(user_id=955fb91fe1bc4272b566b64ee4527121)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:29.269743 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a45d99-93d0-4691-a8e7-28430c572b46 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:29.271451 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 43/83] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:48:29 2022] GET /identity/v3/users/955fb91fe1bc4272b566b64ee4527121 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:29.272051 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a45d99-93d0-4691-a8e7-28430c572b46 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:29.304973 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:29.323410 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340d539-1df8-4aa6-b104-f7042c629115 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:29.357553 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452fec5-b88f-414e-8226-525de03b7543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:29.358149 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452fec5-b88f-414e-8226-525de03b7543 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:29.358424 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452fec5-b88f-414e-8226-525de03b7543 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:29.358828 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452fec5-b88f-414e-8226-525de03b7543 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:29.370162 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a45d99-93d0-4691-a8e7-28430c572b46 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:29.373033 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:29.403533 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca8359-429b-48ad-946b-3f561edb96b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:29.404159 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca8359-429b-48ad-946b-3f561edb96b8 None admin] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:29.404443 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca8359-429b-48ad-946b-3f561edb96b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:29.404712 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca8359-429b-48ad-946b-3f561edb96b8 None admin] PATH_INFO: `/v3/users` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:29.405345 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca8359-429b-48ad-946b-3f561edb96b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:29.406872 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca8359-429b-48ad-946b-3f561edb96b8 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:29.427048 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452fec5-b88f-414e-8226-525de03b7543 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:29.428404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 44/84] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 21 11:48:29 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 11:48:29.428507 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452fec5-b88f-414e-8226-525de03b7543 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:29.429370 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca8359-429b-48ad-946b-3f561edb96b8 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:29.531110 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:29.545731 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca8359-429b-48ad-946b-3f561edb96b8 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:29.547096 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 41/85] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:48:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:48:29.552354 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452fec5-b88f-414e-8226-525de03b7543 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:29.586820 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1a6cd-3a07-4cf2-942b-fd8f08c6f121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:29.587477 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1a6cd-3a07-4cf2-942b-fd8f08c6f121 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:29.587757 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1a6cd-3a07-4cf2-942b-fd8f08c6f121 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:29.588052 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1a6cd-3a07-4cf2-942b-fd8f08c6f121 None admin] PATH_INFO: `/v3/users/955fb91fe1bc4272b566b64ee4527121` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:29.589231 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1a6cd-3a07-4cf2-942b-fd8f08c6f121 None admin] RBAC: Authorizing `identity:get_user(user_id=955fb91fe1bc4272b566b64ee4527121)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:29.590757 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1a6cd-3a07-4cf2-942b-fd8f08c6f121 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:29.592411 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 45/86] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:48:29 2022] GET /identity/v3/users/955fb91fe1bc4272b566b64ee4527121 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:29.598196 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1a6cd-3a07-4cf2-942b-fd8f08c6f121 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:29.609766 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:29.677926 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452fec5-b88f-414e-8226-525de03b7543 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:29.714940 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1a6cd-3a07-4cf2-942b-fd8f08c6f121 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:29.720941 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793f38c-2115-4ef1-b741-01ab99781378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:29.721550 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793f38c-2115-4ef1-b741-01ab99781378 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:29.721826 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793f38c-2115-4ef1-b741-01ab99781378 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:29.722107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793f38c-2115-4ef1-b741-01ab99781378 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:29.756579 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397aa9f8-b1f9-41b6-a1b4-823289317d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:29.757191 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397aa9f8-b1f9-41b6-a1b4-823289317d33 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:29.757465 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397aa9f8-b1f9-41b6-a1b4-823289317d33 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:29.757732 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397aa9f8-b1f9-41b6-a1b4-823289317d33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:29.793537 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:29.805650 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793f38c-2115-4ef1-b741-01ab99781378 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:29.807174 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793f38c-2115-4ef1-b741-01ab99781378 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:29.842436 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397aa9f8-b1f9-41b6-a1b4-823289317d33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:29.844048 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397aa9f8-b1f9-41b6-a1b4-823289317d33 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:29.866860 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:29.934657 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 42/87] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:48:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:48:29.935558 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793f38c-2115-4ef1-b741-01ab99781378 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:29.973377 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 46/88] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:48:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:48:29.974243 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397aa9f8-b1f9-41b6-a1b4-823289317d33 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:30.051058 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:30.060381 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793f38c-2115-4ef1-b741-01ab99781378 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:30.098871 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92c01f-5cf1-4e55-8195-c3bfd256e65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:30.099866 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92c01f-5cf1-4e55-8195-c3bfd256e65e None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:30.100490 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92c01f-5cf1-4e55-8195-c3bfd256e65e None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:30.101065 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92c01f-5cf1-4e55-8195-c3bfd256e65e None admin] PATH_INFO: `/v3/projects/9717263f7d4a452e9bf8dfa0907bda95` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:30.102443 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92c01f-5cf1-4e55-8195-c3bfd256e65e None admin] RBAC: Authorizing `identity:get_project(project_id=9717263f7d4a452e9bf8dfa0907bda95)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:30.104133 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92c01f-5cf1-4e55-8195-c3bfd256e65e None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:30.104397 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397aa9f8-b1f9-41b6-a1b4-823289317d33 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:30.106892 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 43/89] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:48:29 2022] GET /identity/v3/projects/9717263f7d4a452e9bf8dfa0907bda95 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:30.108010 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92c01f-5cf1-4e55-8195-c3bfd256e65e None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:30.123961 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:30.158070 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b96baa-868d-40e5-83c3-ed44458e362a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:30.159491 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b96baa-868d-40e5-83c3-ed44458e362a None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:30.159955 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b96baa-868d-40e5-83c3-ed44458e362a None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:30.160428 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b96baa-868d-40e5-83c3-ed44458e362a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:30.231886 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92c01f-5cf1-4e55-8195-c3bfd256e65e None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:30.245152 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b96baa-868d-40e5-83c3-ed44458e362a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:30.247331 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b96baa-868d-40e5-83c3-ed44458e362a None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:30.285986 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d04e7a-7ed5-46c4-9c19-d9878ac1c808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:30.286898 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d04e7a-7ed5-46c4-9c19-d9878ac1c808 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:30.287335 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d04e7a-7ed5-46c4-9c19-d9878ac1c808 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:30.287967 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d04e7a-7ed5-46c4-9c19-d9878ac1c808 None admin] PATH_INFO: `/v3/projects/9717263f7d4a452e9bf8dfa0907bda95` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:30.290213 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d04e7a-7ed5-46c4-9c19-d9878ac1c808 None admin] RBAC: Authorizing `identity:get_project(project_id=9717263f7d4a452e9bf8dfa0907bda95)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:30.292114 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d04e7a-7ed5-46c4-9c19-d9878ac1c808 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:30.295321 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 44/90] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:48:30 2022] GET /identity/v3/projects/9717263f7d4a452e9bf8dfa0907bda95 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:30.296456 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d04e7a-7ed5-46c4-9c19-d9878ac1c808 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:30.323498 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:30.384435 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 47/91] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:48:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:48:30.385993 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b96baa-868d-40e5-83c3-ed44458e362a None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:30.397196 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:30.424170 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d04e7a-7ed5-46c4-9c19-d9878ac1c808 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:30.461366 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb7569-ba2b-4294-bebe-38af6798d3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:30.462286 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb7569-ba2b-4294-bebe-38af6798d3b6 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:30.462971 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb7569-ba2b-4294-bebe-38af6798d3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:30.463607 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb7569-ba2b-4294-bebe-38af6798d3b6 None admin] PATH_INFO: `/v3/projects/9717263f7d4a452e9bf8dfa0907bda95` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:30.465507 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb7569-ba2b-4294-bebe-38af6798d3b6 None admin] RBAC: Authorizing `identity:get_project(project_id=9717263f7d4a452e9bf8dfa0907bda95)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:30.467200 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb7569-ba2b-4294-bebe-38af6798d3b6 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:30.469385 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 45/92] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:48:30 2022] GET /identity/v3/projects/9717263f7d4a452e9bf8dfa0907bda95 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:30.470179 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb7569-ba2b-4294-bebe-38af6798d3b6 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:30.528895 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b96baa-868d-40e5-83c3-ed44458e362a None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:30.593395 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368109a4-a638-4c96-b9ca-14fb3c9891bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:30.594199 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368109a4-a638-4c96-b9ca-14fb3c9891bf None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:30.594752 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368109a4-a638-4c96-b9ca-14fb3c9891bf None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:30.595282 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368109a4-a638-4c96-b9ca-14fb3c9891bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:30.596307 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368109a4-a638-4c96-b9ca-14fb3c9891bf None admin] RBAC: Adding query filter params (role.id=d1f3d1431da145709a5e9b374f3b403d, scope.project.id=9717263f7d4a452e9bf8dfa0907bda95, user.id=371d9f7c2d964f04b62c347e6b182e88) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:30.597000 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368109a4-a638-4c96-b9ca-14fb3c9891bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:30.599259 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368109a4-a638-4c96-b9ca-14fb3c9891bf None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:30.607625 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 48/93] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 11:48:30 2022] GET /identity/v3/role_assignments?user.id=371d9f7c2d964f04b62c347e6b182e88&scope.project.id=9717263f7d4a452e9bf8dfa0907bda95&role.id=d1f3d1431da145709a5e9b374f3b403d => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:30.608153 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb7569-ba2b-4294-bebe-38af6798d3b6 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:30.608802 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368109a4-a638-4c96-b9ca-14fb3c9891bf None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:30.644248 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:30.646424 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a94a9-5f7d-47c5-8e8d-d1a52406a6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:30.647431 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a94a9-5f7d-47c5-8e8d-d1a52406a6d1 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:30.647834 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a94a9-5f7d-47c5-8e8d-d1a52406a6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:30.648234 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a94a9-5f7d-47c5-8e8d-d1a52406a6d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:30.649142 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a94a9-5f7d-47c5-8e8d-d1a52406a6d1 None admin] RBAC: Adding query filter params (role.id=165db5ccce0540569e708b81df7a5577, scope.project.id=9717263f7d4a452e9bf8dfa0907bda95, user.id=955fb91fe1bc4272b566b64ee4527121) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:30.649545 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a94a9-5f7d-47c5-8e8d-d1a52406a6d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:30.651236 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a94a9-5f7d-47c5-8e8d-d1a52406a6d1 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:30.660472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 46/94] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 11:48:30 2022] GET /identity/v3/role_assignments?user.id=955fb91fe1bc4272b566b64ee4527121&scope.project.id=9717263f7d4a452e9bf8dfa0907bda95&role.id=165db5ccce0540569e708b81df7a5577 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:30.668041 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a94a9-5f7d-47c5-8e8d-d1a52406a6d1 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:30.701133 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:30.813646 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368109a4-a638-4c96-b9ca-14fb3c9891bf None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:30.893318 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a15cb-8ff3-458e-a6ca-6699a648d24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:30.893965 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a15cb-8ff3-458e-a6ca-6699a648d24e None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:30.894243 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a15cb-8ff3-458e-a6ca-6699a648d24e None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:30.894513 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a15cb-8ff3-458e-a6ca-6699a648d24e None admin] PATH_INFO: `/v3/projects/e6471a8fe6554c5aa0224d1bc08a702d` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:30.896544 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a94a9-5f7d-47c5-8e8d-d1a52406a6d1 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:30.900095 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a15cb-8ff3-458e-a6ca-6699a648d24e None admin] RBAC: Authorizing `identity:get_project(project_id=e6471a8fe6554c5aa0224d1bc08a702d)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:30.901662 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a15cb-8ff3-458e-a6ca-6699a648d24e None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:30.908846 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 49/95] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:48:30 2022] GET /identity/v3/projects/e6471a8fe6554c5aa0224d1bc08a702d => generated 312 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:30.909792 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a15cb-8ff3-458e-a6ca-6699a648d24e None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:31.021535 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ec06b-6185-4a3b-909d-a3ea85396145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:31.022169 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ec06b-6185-4a3b-909d-a3ea85396145 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:31.022454 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ec06b-6185-4a3b-909d-a3ea85396145 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:31.022734 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ec06b-6185-4a3b-909d-a3ea85396145 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:31.023478 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ec06b-6185-4a3b-909d-a3ea85396145 None admin] RBAC: Adding query filter params (role.id=c163d39b46d24a27a76fb9026fec24ff, scope.project.id=9717263f7d4a452e9bf8dfa0907bda95, user.id=955fb91fe1bc4272b566b64ee4527121) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:31.023789 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ec06b-6185-4a3b-909d-a3ea85396145 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:31.025326 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ec06b-6185-4a3b-909d-a3ea85396145 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:31.038912 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 47/96] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 11:48:30 2022] GET /identity/v3/role_assignments?user.id=955fb91fe1bc4272b566b64ee4527121&scope.project.id=9717263f7d4a452e9bf8dfa0907bda95&role.id=c163d39b46d24a27a76fb9026fec24ff => generated 259 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:31.088944 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:31.103756 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a15cb-8ff3-458e-a6ca-6699a648d24e None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:31.157352 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31363f26-9594-4c84-ab35-b9b9dac8abf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:31.157983 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31363f26-9594-4c84-ab35-b9b9dac8abf2 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:31.158265 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31363f26-9594-4c84-ab35-b9b9dac8abf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:31.158538 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31363f26-9594-4c84-ab35-b9b9dac8abf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:31.159340 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31363f26-9594-4c84-ab35-b9b9dac8abf2 None admin] RBAC: Adding query filter params (role.id=165db5ccce0540569e708b81df7a5577, scope.project.id=e6471a8fe6554c5aa0224d1bc08a702d, user.id=955fb91fe1bc4272b566b64ee4527121) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:31.159655 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31363f26-9594-4c84-ab35-b9b9dac8abf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:31.161240 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31363f26-9594-4c84-ab35-b9b9dac8abf2 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:31.171031 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 50/97] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 11:48:30 2022] GET /identity/v3/role_assignments?user.id=955fb91fe1bc4272b566b64ee4527121&scope.project.id=e6471a8fe6554c5aa0224d1bc08a702d&role.id=165db5ccce0540569e708b81df7a5577 => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:32.260112 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db0dae-e6f9-41e5-85bd-96221d9c26ea None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:32.260620 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db0dae-e6f9-41e5-85bd-96221d9c26ea None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:32.260695 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db0dae-e6f9-41e5-85bd-96221d9c26ea None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:32.262855 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 48/98] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:32.268428 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3611907-98a4-45a8-a7ca-85793283a1b9 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:32.268834 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3611907-98a4-45a8-a7ca-85793283a1b9 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:32.269006 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3611907-98a4-45a8-a7ca-85793283a1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:32.292932 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-f3611907-98a4-45a8-a7ca-85793283a1b9 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:32.294142 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-f3611907-98a4-45a8-a7ca-85793283a1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:32.373957 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 51/99] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 11:48:32.412311 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b13f3c-144a-426a-a11f-123d1503865b None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:32.412577 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b13f3c-144a-426a-a11f-123d1503865b None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:32.412856 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b13f3c-144a-426a-a11f-123d1503865b None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:32.414193 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 49/100] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 11:48:32.420295 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae5e95-72c1-4642-b798-d98a4838f9fe None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:32.420585 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae5e95-72c1-4642-b798-d98a4838f9fe None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:32.420856 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae5e95-72c1-4642-b798-d98a4838f9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:32.444950 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-2eae5e95-72c1-4642-b798-d98a4838f9fe None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:32.446114 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-2eae5e95-72c1-4642-b798-d98a4838f9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:32.527131 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 52/101] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:48:33.037590 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b13f3c-144a-426a-a11f-123d1503865b None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:33.137926 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:33.166940 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b13f3c-144a-426a-a11f-123d1503865b None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:33.175182 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae5e95-72c1-4642-b798-d98a4838f9fe None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:33.217255 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:33.221027 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34eefcd-30d1-4653-b175-dc85b3614cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:33.221670 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34eefcd-30d1-4653-b175-dc85b3614cf9 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:33.221955 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34eefcd-30d1-4653-b175-dc85b3614cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:33.222226 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34eefcd-30d1-4653-b175-dc85b3614cf9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:33.249135 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34eefcd-30d1-4653-b175-dc85b3614cf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:48:33.254755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-a34eefcd-30d1-4653-b175-dc85b3614cf9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 11:48:33.254755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:48:33.254755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:48:33.254755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:48:33.254755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:48:33.254755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:48:33.254755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:48:33.254755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:48:33.254755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:48:33.254755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:48:33.254755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:48:33.254755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:48:33.254755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:48:33.254755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:48:33.254755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:48:33.254755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:48:33.255745 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:48:33.255745 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:48:33.255745 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:48:33.255745 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:48:33.255745 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:48:33.255745 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:48:33.255745 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:48:33.255745 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:48:33.255745 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:48:33.255745 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:48:33.255745 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:48:33.255745 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:48:33.255745 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:48:33.255745 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:48:33.255745 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:48:33.255745 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:48:33.256570 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:48:33.256570 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:48:33.256570 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:48:33.256570 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:48:33.256570 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:48:33.256570 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:48:33.256570 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:48:33.256570 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:48:33.256570 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:48:33.256570 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:48:33.256570 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 11:48:33.256570 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:48:33.256570 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 50/102] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:48:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:48:33.262174 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34eefcd-30d1-4653-b175-dc85b3614cf9 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:33.379875 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae5e95-72c1-4642-b798-d98a4838f9fe None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:33.438921 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed2989-03cb-4f2e-ad13-ad6359d429df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:33.440096 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed2989-03cb-4f2e-ad13-ad6359d429df None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:33.441376 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed2989-03cb-4f2e-ad13-ad6359d429df None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:33.443390 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed2989-03cb-4f2e-ad13-ad6359d429df None admin] PATH_INFO: `/v3/domains/default` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:33.446083 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed2989-03cb-4f2e-ad13-ad6359d429df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:33.450155 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed2989-03cb-4f2e-ad13-ad6359d429df None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:33.451956 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 53/103] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:48:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:33.457477 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed2989-03cb-4f2e-ad13-ad6359d429df None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:33.474780 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34eefcd-30d1-4653-b175-dc85b3614cf9 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:33.530863 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ded33e-38a0-428a-b322-b25be7941a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:33.531927 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ded33e-38a0-428a-b322-b25be7941a23 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:33.532404 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ded33e-38a0-428a-b322-b25be7941a23 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:33.532908 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ded33e-38a0-428a-b322-b25be7941a23 None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:33.533887 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ded33e-38a0-428a-b322-b25be7941a23 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:33.534365 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ded33e-38a0-428a-b322-b25be7941a23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:33.536004 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ded33e-38a0-428a-b322-b25be7941a23 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:33.541905 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:33.555414 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 51/104] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 11:48:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:33.561944 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ded33e-38a0-428a-b322-b25be7941a23 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:33.594053 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:33.638763 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed2989-03cb-4f2e-ad13-ad6359d429df None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:33.717908 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7e6b1-249a-4aaa-81f8-c78011014ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:33.718572 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7e6b1-249a-4aaa-81f8-c78011014ae2 None admin] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:33.718859 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7e6b1-249a-4aaa-81f8-c78011014ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:33.719132 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7e6b1-249a-4aaa-81f8-c78011014ae2 None admin] PATH_INFO: `/v3/projects` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:33.720069 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7e6b1-249a-4aaa-81f8-c78011014ae2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:33.721569 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7e6b1-249a-4aaa-81f8-c78011014ae2 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:33.782987 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 54/105] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 21 11:48:33 2022] POST /identity/v3/projects => generated 302 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 11:48:33.810353 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ded33e-38a0-428a-b322-b25be7941a23 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:33.868869 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c4330-3f00-4703-913f-14a6773bfe6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:33.869537 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c4330-3f00-4703-913f-14a6773bfe6c None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:33.869825 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c4330-3f00-4703-913f-14a6773bfe6c None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:33.870107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c4330-3f00-4703-913f-14a6773bfe6c None admin] PATH_INFO: `/v3/users/a691d755caaf42bf906cccf9a9b883ab` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:33.892232 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c4330-3f00-4703-913f-14a6773bfe6c None admin] RBAC: Authorizing `identity:get_user(user_id=a691d755caaf42bf906cccf9a9b883ab)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:33.893635 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c4330-3f00-4703-913f-14a6773bfe6c None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:33.895458 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 52/106] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:48:33 2022] GET /identity/v3/users/a691d755caaf42bf906cccf9a9b883ab => generated 289 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:48:33.901513 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7e6b1-249a-4aaa-81f8-c78011014ae2 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:34.053936 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7e6b1-249a-4aaa-81f8-c78011014ae2 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:34.099558 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfff70-bf80-4ce2-b69c-4c76d55c9720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:34.100597 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfff70-bf80-4ce2-b69c-4c76d55c9720 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:34.101073 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfff70-bf80-4ce2-b69c-4c76d55c9720 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:34.101727 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfff70-bf80-4ce2-b69c-4c76d55c9720 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:34.105172 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:34.208404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfff70-bf80-4ce2-b69c-4c76d55c9720 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:34.209839 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfff70-bf80-4ce2-b69c-4c76d55c9720 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:34.344476 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1f9ae-113b-4617-90c9-4b51ae23fb74 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:34.345524 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1f9ae-113b-4617-90c9-4b51ae23fb74 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:34.346025 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1f9ae-113b-4617-90c9-4b51ae23fb74 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:34.347688 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 53/107] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:34.359261 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081c314-b672-4004-9851-3a7a4e5a5dde None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:34.359884 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081c314-b672-4004-9851-3a7a4e5a5dde None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:34.360392 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081c314-b672-4004-9851-3a7a4e5a5dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:34.378874 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 55/108] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:48:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:48:34.385751 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfff70-bf80-4ce2-b69c-4c76d55c9720 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:34.389973 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-1081c314-b672-4004-9851-3a7a4e5a5dde None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:34.392263 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-1081c314-b672-4004-9851-3a7a4e5a5dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:34.448357 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:34.521711 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:34.556303 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 54/109] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 11:48:34.564623 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfff70-bf80-4ce2-b69c-4c76d55c9720 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:34.602595 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c97ec-00b1-4a40-8b74-fafed447c89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:34.603237 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c97ec-00b1-4a40-8b74-fafed447c89b None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:34.603517 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c97ec-00b1-4a40-8b74-fafed447c89b None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:34.603793 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c97ec-00b1-4a40-8b74-fafed447c89b None admin] PATH_INFO: `/v3/projects/9717263f7d4a452e9bf8dfa0907bda95` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:34.604988 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c97ec-00b1-4a40-8b74-fafed447c89b None admin] RBAC: Authorizing `identity:get_project(project_id=9717263f7d4a452e9bf8dfa0907bda95)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:34.607038 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c97ec-00b1-4a40-8b74-fafed447c89b None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:34.614089 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 56/110] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:48:34 2022] GET /identity/v3/projects/9717263f7d4a452e9bf8dfa0907bda95 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:48:34.615577 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081c314-b672-4004-9851-3a7a4e5a5dde None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:34.724966 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081c314-b672-4004-9851-3a7a4e5a5dde None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:34.762387 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1087b45-55d3-4e6f-82f3-e08e182fe593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:34.762992 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1087b45-55d3-4e6f-82f3-e08e182fe593 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:34.763269 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1087b45-55d3-4e6f-82f3-e08e182fe593 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:34.763542 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1087b45-55d3-4e6f-82f3-e08e182fe593 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:34.764307 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1087b45-55d3-4e6f-82f3-e08e182fe593 None admin] RBAC: Adding query filter params (role.id=bc70cac1c1b444989feeffc53b52d9ae, scope.project.id=9717263f7d4a452e9bf8dfa0907bda95, user.id=a691d755caaf42bf906cccf9a9b883ab) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:34.764610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1087b45-55d3-4e6f-82f3-e08e182fe593 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:34.766061 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1087b45-55d3-4e6f-82f3-e08e182fe593 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:34.776211 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 55/111] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 11:48:34 2022] GET /identity/v3/role_assignments?user.id=a691d755caaf42bf906cccf9a9b883ab&scope.project.id=9717263f7d4a452e9bf8dfa0907bda95&role.id=bc70cac1c1b444989feeffc53b52d9ae => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:34.849542 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea2060-5a9b-4d50-85cc-24c39efec153 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:34.849844 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea2060-5a9b-4d50-85cc-24c39efec153 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:34.850098 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea2060-5a9b-4d50-85cc-24c39efec153 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:34.851571 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 57/112] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:34.857663 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52673e3-1756-413e-b716-831730cdb4bf None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:34.857943 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52673e3-1756-413e-b716-831730cdb4bf None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:34.858214 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52673e3-1756-413e-b716-831730cdb4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:34.885162 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-d52673e3-1756-413e-b716-831730cdb4bf None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:34.886431 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-d52673e3-1756-413e-b716-831730cdb4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:34.935746 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fd365-2162-4ad0-b7e9-77c541dc1bd9 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:34.936087 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fd365-2162-4ad0-b7e9-77c541dc1bd9 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:34.936309 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fd365-2162-4ad0-b7e9-77c541dc1bd9 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:34.937799 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 58/113] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 11:48:34.943213 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6b7e3-febe-4569-94f5-641a5b433087 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:34.943491 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6b7e3-febe-4569-94f5-641a5b433087 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:34.943767 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6b7e3-febe-4569-94f5-641a5b433087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:34.976450 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-7fa6b7e3-febe-4569-94f5-641a5b433087 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:34.977651 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-7fa6b7e3-febe-4569-94f5-641a5b433087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:34.986093 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:35.040997 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 56/114] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:48:35.131824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 59/115] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 11:48:35.173317 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52673e3-1756-413e-b716-831730cdb4bf None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:35.197251 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a388a2-d6d8-4f61-976d-322c160e3dd3 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:35.197560 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a388a2-d6d8-4f61-976d-322c160e3dd3 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:35.197788 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a388a2-d6d8-4f61-976d-322c160e3dd3 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:35.199770 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 60/116] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:35.205576 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e40f0-d9b3-4a57-b2a2-18103f3b2540 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:35.206225 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e40f0-d9b3-4a57-b2a2-18103f3b2540 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:35.206647 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e40f0-d9b3-4a57-b2a2-18103f3b2540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:35.241099 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-381e40f0-d9b3-4a57-b2a2-18103f3b2540 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:35.242646 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-381e40f0-d9b3-4a57-b2a2-18103f3b2540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:35.304599 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:35.318824 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52673e3-1756-413e-b716-831730cdb4bf None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:35.360461 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 61/117] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:48:35.383211 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44173fa1-6b4e-48e3-a3ed-b29e79f0065c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:35.383856 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44173fa1-6b4e-48e3-a3ed-b29e79f0065c None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:35.384170 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44173fa1-6b4e-48e3-a3ed-b29e79f0065c None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:35.384446 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44173fa1-6b4e-48e3-a3ed-b29e79f0065c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:35.397336 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44173fa1-6b4e-48e3-a3ed-b29e79f0065c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:48:35.402273 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-44173fa1-6b4e-48e3-a3ed-b29e79f0065c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:48:35.402273 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:48:35.402273 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:48:35.402273 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:48:35.402273 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:48:35.402273 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:48:35.402273 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:48:35.402273 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:48:35.402273 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:48:35.402273 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:48:35.402273 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:48:35.402273 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:48:35.402273 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:48:35.402273 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:48:35.402273 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:48:35.402273 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:48:35.403150 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:48:35.403150 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:48:35.403150 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:48:35.403150 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:48:35.403150 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:48:35.403150 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:48:35.403150 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:48:35.403150 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:48:35.403150 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:48:35.403150 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:48:35.403150 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:48:35.403150 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:48:35.403150 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:48:35.403150 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:48:35.403150 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:48:35.403150 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:48:35.403961 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:48:35.403961 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:48:35.403961 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:48:35.403961 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:48:35.403961 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:48:35.403961 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:48:35.403961 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:48:35.403961 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:48:35.403961 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:48:35.403961 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:48:35.403961 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:48:35.403961 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:48:35.409451 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e40f0-d9b3-4a57-b2a2-18103f3b2540 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:35.424547 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 57/118] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:48:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:48:35.523833 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44173fa1-6b4e-48e3-a3ed-b29e79f0065c None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:35.570094 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e40f0-d9b3-4a57-b2a2-18103f3b2540 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:35.613638 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:35.639064 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f17a39-3f1c-4bae-b8bd-d416d7ed1655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:35.639749 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f17a39-3f1c-4bae-b8bd-d416d7ed1655 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:35.640061 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f17a39-3f1c-4bae-b8bd-d416d7ed1655 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:35.640341 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f17a39-3f1c-4bae-b8bd-d416d7ed1655 None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:35.641016 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f17a39-3f1c-4bae-b8bd-d416d7ed1655 None admin] RBAC: Adding query filter params (name=member) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:35.641319 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f17a39-3f1c-4bae-b8bd-d416d7ed1655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:35.642701 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f17a39-3f1c-4bae-b8bd-d416d7ed1655 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:35.656741 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 62/119] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 11:48:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:35.664023 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f17a39-3f1c-4bae-b8bd-d416d7ed1655 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:35.684511 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44173fa1-6b4e-48e3-a3ed-b29e79f0065c None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:35.708377 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:35.727044 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff4a8b-00ad-4e0f-a846-e500c470e79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:35.727964 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff4a8b-00ad-4e0f-a846-e500c470e79a None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:35.728490 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff4a8b-00ad-4e0f-a846-e500c470e79a None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:35.728903 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff4a8b-00ad-4e0f-a846-e500c470e79a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:35.746820 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff4a8b-00ad-4e0f-a846-e500c470e79a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:48:35.753942 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-89ff4a8b-00ad-4e0f-a846-e500c470e79a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:48:35.753942 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:48:35.753942 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:48:35.753942 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:48:35.753942 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:48:35.753942 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:48:35.753942 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:48:35.753942 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:48:35.753942 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:48:35.753942 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:48:35.753942 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:48:35.753942 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:48:35.753942 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:48:35.753942 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:48:35.753942 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:48:35.753942 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:48:35.755025 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:48:35.755025 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:48:35.755025 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:48:35.755025 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:48:35.755025 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:48:35.755025 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:48:35.755025 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:48:35.755025 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:48:35.755025 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:48:35.755025 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:48:35.755025 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:48:35.755025 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:48:35.755025 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:48:35.755025 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:48:35.755025 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:48:35.755025 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:48:35.756019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:48:35.756019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:48:35.756019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:48:35.756019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:48:35.756019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:48:35.756019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:48:35.756019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:48:35.756019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:48:35.756019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:48:35.756019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:48:35.756019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:48:35.756019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:48:35.761131 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 58/120] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 11:48:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 11:48:35.764525 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff4a8b-00ad-4e0f-a846-e500c470e79a None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:35.833443 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f17a39-3f1c-4bae-b8bd-d416d7ed1655 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:35.879741 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24696638-b65f-44fe-9c06-c673c6549c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:35.880977 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24696638-b65f-44fe-9c06-c673c6549c5b None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:35.881427 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24696638-b65f-44fe-9c06-c673c6549c5b None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:35.882098 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24696638-b65f-44fe-9c06-c673c6549c5b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:35.895896 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:35.897805 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24696638-b65f-44fe-9c06-c673c6549c5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:48:35.899221 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff4a8b-00ad-4e0f-a846-e500c470e79a None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:35.906855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-24696638-b65f-44fe-9c06-c673c6549c5b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 11:48:35.906855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:48:35.906855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:48:35.906855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:48:35.906855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:48:35.906855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:48:35.906855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:48:35.906855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:48:35.906855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:48:35.906855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:48:35.906855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:48:35.906855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:48:35.906855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:48:35.906855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:48:35.906855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:48:35.906855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:48:35.907923 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:48:35.907923 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:48:35.907923 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:48:35.907923 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:48:35.907923 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:48:35.907923 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:48:35.907923 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:48:35.907923 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:48:35.907923 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:48:35.907923 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:48:35.907923 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:48:35.907923 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:48:35.907923 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:48:35.907923 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:48:35.907923 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:48:35.907923 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:48:35.908782 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:48:35.908782 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:48:35.908782 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:48:35.908782 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:48:35.908782 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:48:35.908782 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:48:35.908782 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:48:35.908782 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:48:35.908782 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:48:35.908782 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:48:35.908782 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 11:48:35.908782 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:48:35.909363 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 63/121] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 11:48:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:48:35.910468 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24696638-b65f-44fe-9c06-c673c6549c5b None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:35.954984 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194aadf-be79-4d58-8a41-045d6b120b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:35.956311 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194aadf-be79-4d58-8a41-045d6b120b91 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:35.957149 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194aadf-be79-4d58-8a41-045d6b120b91 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:35.957879 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194aadf-be79-4d58-8a41-045d6b120b91 None admin] PATH_INFO: `/v3/users/955fb91fe1bc4272b566b64ee4527121` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:35.959241 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194aadf-be79-4d58-8a41-045d6b120b91 None admin] RBAC: Authorizing `identity:get_user(user_id=955fb91fe1bc4272b566b64ee4527121)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:35.962146 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194aadf-be79-4d58-8a41-045d6b120b91 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:35.964510 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 59/122] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:48:35 2022] GET /identity/v3/users/955fb91fe1bc4272b566b64ee4527121 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:35.966751 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194aadf-be79-4d58-8a41-045d6b120b91 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:36.013205 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:36.031408 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24696638-b65f-44fe-9c06-c673c6549c5b None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:36.067047 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270aefc7-b207-4690-a42d-f41704bc6753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:36.067679 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270aefc7-b207-4690-a42d-f41704bc6753 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:36.068026 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270aefc7-b207-4690-a42d-f41704bc6753 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:36.068309 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270aefc7-b207-4690-a42d-f41704bc6753 None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:36.069644 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270aefc7-b207-4690-a42d-f41704bc6753 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:36.069644 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270aefc7-b207-4690-a42d-f41704bc6753 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:36.070906 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270aefc7-b207-4690-a42d-f41704bc6753 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:36.079860 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 64/123] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:48:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:36.080317 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270aefc7-b207-4690-a42d-f41704bc6753 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:36.110860 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194aadf-be79-4d58-8a41-045d6b120b91 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:36.158554 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96179b9-7d8a-47f5-8c15-f6b4141cff70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:36.160100 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96179b9-7d8a-47f5-8c15-f6b4141cff70 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:36.160597 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96179b9-7d8a-47f5-8c15-f6b4141cff70 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:36.161075 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96179b9-7d8a-47f5-8c15-f6b4141cff70 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:36.176040 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96179b9-7d8a-47f5-8c15-f6b4141cff70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:48:36.183800 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-d96179b9-7d8a-47f5-8c15-f6b4141cff70 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:48:36.183800 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:48:36.183800 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:48:36.183800 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:48:36.183800 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:48:36.183800 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:48:36.183800 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:48:36.183800 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:48:36.183800 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:48:36.183800 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:48:36.183800 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:48:36.183800 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:48:36.183800 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:48:36.183800 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:48:36.183800 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:48:36.183800 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:48:36.184867 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:48:36.184867 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:48:36.184867 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:48:36.184867 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:48:36.184867 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:48:36.184867 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:48:36.184867 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:48:36.184867 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:48:36.184867 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:48:36.184867 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:48:36.184867 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:48:36.184867 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:48:36.184867 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:48:36.184867 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:48:36.184867 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:48:36.184867 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:48:36.185700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:48:36.185700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:48:36.185700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:48:36.185700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:48:36.185700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:48:36.185700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:48:36.185700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:48:36.185700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:48:36.185700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:48:36.185700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:48:36.185700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:48:36.185700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:48:36.186305 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270aefc7-b207-4690-a42d-f41704bc6753 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:36.189117 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 60/124] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:48:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:48:36.190259 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96179b9-7d8a-47f5-8c15-f6b4141cff70 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:36.230210 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:36.231157 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c69bb-8183-4168-a822-cbe4004ae95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:36.231830 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c69bb-8183-4168-a822-cbe4004ae95c None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:36.232148 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c69bb-8183-4168-a822-cbe4004ae95c None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:36.232413 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c69bb-8183-4168-a822-cbe4004ae95c None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:36.233076 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c69bb-8183-4168-a822-cbe4004ae95c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:36.233377 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c69bb-8183-4168-a822-cbe4004ae95c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:36.235093 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c69bb-8183-4168-a822-cbe4004ae95c None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:36.243795 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 65/125] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:48:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:36.249011 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c69bb-8183-4168-a822-cbe4004ae95c None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:36.260380 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:36.341273 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96179b9-7d8a-47f5-8c15-f6b4141cff70 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:36.369919 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c69bb-8183-4168-a822-cbe4004ae95c None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:36.377869 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6151dd1-813f-41c2-8467-52a6224f53e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:36.378502 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6151dd1-813f-41c2-8467-52a6224f53e8 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:36.378783 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6151dd1-813f-41c2-8467-52a6224f53e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:36.379058 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6151dd1-813f-41c2-8467-52a6224f53e8 None admin] PATH_INFO: `/v3/projects/9717263f7d4a452e9bf8dfa0907bda95` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:36.380274 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6151dd1-813f-41c2-8467-52a6224f53e8 None admin] RBAC: Authorizing `identity:get_project(project_id=9717263f7d4a452e9bf8dfa0907bda95)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:36.381745 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6151dd1-813f-41c2-8467-52a6224f53e8 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:36.383391 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 61/126] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:48:36 2022] GET /identity/v3/projects/9717263f7d4a452e9bf8dfa0907bda95 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:36.384191 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6151dd1-813f-41c2-8467-52a6224f53e8 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:36.423917 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf2335-accc-4099-9d25-fdad2b54f3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:36.424630 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf2335-accc-4099-9d25-fdad2b54f3f8 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:36.424874 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf2335-accc-4099-9d25-fdad2b54f3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:36.425125 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf2335-accc-4099-9d25-fdad2b54f3f8 None admin] PATH_INFO: `/v3/users/371d9f7c2d964f04b62c347e6b182e88` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:36.426383 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf2335-accc-4099-9d25-fdad2b54f3f8 None admin] RBAC: Authorizing `identity:get_user(user_id=371d9f7c2d964f04b62c347e6b182e88)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:36.429351 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf2335-accc-4099-9d25-fdad2b54f3f8 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:36.432153 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 66/127] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:48:36 2022] GET /identity/v3/users/371d9f7c2d964f04b62c347e6b182e88 => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:36.433203 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf2335-accc-4099-9d25-fdad2b54f3f8 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:36.499681 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:36.507079 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6151dd1-813f-41c2-8467-52a6224f53e8 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:36.535434 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:36.553969 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14673273-5e7b-40ca-8fb2-7a949c50630c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:36.554992 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14673273-5e7b-40ca-8fb2-7a949c50630c None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:36.555502 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14673273-5e7b-40ca-8fb2-7a949c50630c None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:36.556020 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14673273-5e7b-40ca-8fb2-7a949c50630c None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:36.556779 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14673273-5e7b-40ca-8fb2-7a949c50630c None admin] RBAC: Adding query filter params (name=member) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:36.557090 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14673273-5e7b-40ca-8fb2-7a949c50630c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:36.558609 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14673273-5e7b-40ca-8fb2-7a949c50630c None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:36.573183 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 62/128] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 11:48:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:36.574179 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14673273-5e7b-40ca-8fb2-7a949c50630c None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:36.578703 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf2335-accc-4099-9d25-fdad2b54f3f8 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:36.623921 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6a918-02a2-406c-bb3b-930d87f504d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:36.624648 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6a918-02a2-406c-bb3b-930d87f504d0 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:36.624929 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6a918-02a2-406c-bb3b-930d87f504d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:36.625251 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6a918-02a2-406c-bb3b-930d87f504d0 None admin] PATH_INFO: `/v3/users/955fb91fe1bc4272b566b64ee4527121` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:36.626401 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6a918-02a2-406c-bb3b-930d87f504d0 None admin] RBAC: Authorizing `identity:get_user(user_id=955fb91fe1bc4272b566b64ee4527121)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:36.627858 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6a918-02a2-406c-bb3b-930d87f504d0 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:36.629643 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 67/129] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:48:36 2022] GET /identity/v3/users/955fb91fe1bc4272b566b64ee4527121 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:36.630214 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6a918-02a2-406c-bb3b-930d87f504d0 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:36.717450 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14673273-5e7b-40ca-8fb2-7a949c50630c None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:36.753676 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4320c62-743a-4043-be7d-035ef5ace752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:36.754390 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4320c62-743a-4043-be7d-035ef5ace752 None admin] REQUEST_METHOD: `PUT` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:36.754672 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4320c62-743a-4043-be7d-035ef5ace752 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:36.754984 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4320c62-743a-4043-be7d-035ef5ace752 None admin] PATH_INFO: `/v3/projects/9717263f7d4a452e9bf8dfa0907bda95/users/955fb91fe1bc4272b566b64ee4527121/roles/165db5ccce0540569e708b81df7a5577` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:36.756922 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6a918-02a2-406c-bb3b-930d87f504d0 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:36.757047 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4320c62-743a-4043-be7d-035ef5ace752 None admin] RBAC: Authorizing `identity:create_grant(project_id=9717263f7d4a452e9bf8dfa0907bda95, user_id=955fb91fe1bc4272b566b64ee4527121, role_id=165db5ccce0540569e708b81df7a5577)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:36.758410 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4320c62-743a-4043-be7d-035ef5ace752 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:36.772563 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 63/130] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 11:48:36 2022] PUT /identity/v3/projects/9717263f7d4a452e9bf8dfa0907bda95/users/955fb91fe1bc4272b566b64ee4527121/roles/165db5ccce0540569e708b81df7a5577 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 11:48:36.773502 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4320c62-743a-4043-be7d-035ef5ace752 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:36.796231 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:36.801542 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e4f84-29be-45f6-9c14-3dd1d4aebfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:36.802788 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e4f84-29be-45f6-9c14-3dd1d4aebfe4 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:36.803356 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e4f84-29be-45f6-9c14-3dd1d4aebfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:36.803913 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e4f84-29be-45f6-9c14-3dd1d4aebfe4 None admin] PATH_INFO: `/v3/projects/9717263f7d4a452e9bf8dfa0907bda95` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:36.806308 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e4f84-29be-45f6-9c14-3dd1d4aebfe4 None admin] RBAC: Authorizing `identity:get_project(project_id=9717263f7d4a452e9bf8dfa0907bda95)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:36.808143 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e4f84-29be-45f6-9c14-3dd1d4aebfe4 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:36.810436 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 68/131] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:48:36 2022] GET /identity/v3/projects/9717263f7d4a452e9bf8dfa0907bda95 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:36.811718 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e4f84-29be-45f6-9c14-3dd1d4aebfe4 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:36.828646 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:36.903093 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4320c62-743a-4043-be7d-035ef5ace752 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:36.936383 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e4f84-29be-45f6-9c14-3dd1d4aebfe4 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:36.941786 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea380816-643f-409e-a8a8-cfbaac4f244a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:36.942504 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea380816-643f-409e-a8a8-cfbaac4f244a None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:36.942855 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea380816-643f-409e-a8a8-cfbaac4f244a None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:36.943135 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea380816-643f-409e-a8a8-cfbaac4f244a None admin] PATH_INFO: `/v3/users/955fb91fe1bc4272b566b64ee4527121` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:36.944433 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea380816-643f-409e-a8a8-cfbaac4f244a None admin] RBAC: Authorizing `identity:get_user(user_id=955fb91fe1bc4272b566b64ee4527121)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:36.945925 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea380816-643f-409e-a8a8-cfbaac4f244a None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:36.947896 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 64/132] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:48:36 2022] GET /identity/v3/users/955fb91fe1bc4272b566b64ee4527121 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:36.948746 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea380816-643f-409e-a8a8-cfbaac4f244a None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:36.980539 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb440822-dae3-4dba-95e1-4c6751416878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:36.981786 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb440822-dae3-4dba-95e1-4c6751416878 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:36.982493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb440822-dae3-4dba-95e1-4c6751416878 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:36.983055 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb440822-dae3-4dba-95e1-4c6751416878 None admin] PATH_INFO: `/v3/projects/9717263f7d4a452e9bf8dfa0907bda95` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:36.990563 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb440822-dae3-4dba-95e1-4c6751416878 None admin] RBAC: Authorizing `identity:get_project(project_id=9717263f7d4a452e9bf8dfa0907bda95)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:36.992414 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb440822-dae3-4dba-95e1-4c6751416878 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:36.994616 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 69/133] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:48:36 2022] GET /identity/v3/projects/9717263f7d4a452e9bf8dfa0907bda95 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:36.999411 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb440822-dae3-4dba-95e1-4c6751416878 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:37.060741 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:37.070005 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea380816-643f-409e-a8a8-cfbaac4f244a None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:37.108738 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660fe13-99d0-440e-80e5-68fff4874b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:37.109415 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660fe13-99d0-440e-80e5-68fff4874b52 None admin] REQUEST_METHOD: `PUT` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:37.109697 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660fe13-99d0-440e-80e5-68fff4874b52 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:37.109973 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660fe13-99d0-440e-80e5-68fff4874b52 None admin] PATH_INFO: `/v3/projects/9717263f7d4a452e9bf8dfa0907bda95/users/371d9f7c2d964f04b62c347e6b182e88/roles/d1f3d1431da145709a5e9b374f3b403d` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:37.112526 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660fe13-99d0-440e-80e5-68fff4874b52 None admin] RBAC: Authorizing `identity:create_grant(project_id=9717263f7d4a452e9bf8dfa0907bda95, user_id=371d9f7c2d964f04b62c347e6b182e88, role_id=d1f3d1431da145709a5e9b374f3b403d)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:37.113663 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660fe13-99d0-440e-80e5-68fff4874b52 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:37.133131 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 65/134] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 11:48:36 2022] PUT /identity/v3/projects/9717263f7d4a452e9bf8dfa0907bda95/users/371d9f7c2d964f04b62c347e6b182e88/roles/d1f3d1431da145709a5e9b374f3b403d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 11:48:37.134758 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660fe13-99d0-440e-80e5-68fff4874b52 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:37.150923 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:37.181339 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb440822-dae3-4dba-95e1-4c6751416878 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:37.227144 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae9313-1422-4c4f-9d2b-9021620a1741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:37.228785 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae9313-1422-4c4f-9d2b-9021620a1741 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:37.229311 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae9313-1422-4c4f-9d2b-9021620a1741 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:37.229790 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae9313-1422-4c4f-9d2b-9021620a1741 None admin] PATH_INFO: `/v3/projects/e6471a8fe6554c5aa0224d1bc08a702d` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:37.231334 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae9313-1422-4c4f-9d2b-9021620a1741 None admin] RBAC: Authorizing `identity:get_project(project_id=e6471a8fe6554c5aa0224d1bc08a702d)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:37.233470 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae9313-1422-4c4f-9d2b-9021620a1741 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:37.236050 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 70/135] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:48:36 2022] GET /identity/v3/projects/e6471a8fe6554c5aa0224d1bc08a702d => generated 312 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:37.246989 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae9313-1422-4c4f-9d2b-9021620a1741 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:37.340244 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660fe13-99d0-440e-80e5-68fff4874b52 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:37.395150 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c160328-6fe2-4054-8c9d-b73773e0fb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:37.396638 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c160328-6fe2-4054-8c9d-b73773e0fb74 None admin] REQUEST_METHOD: `PUT` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:37.396911 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c160328-6fe2-4054-8c9d-b73773e0fb74 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:37.397191 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c160328-6fe2-4054-8c9d-b73773e0fb74 None admin] PATH_INFO: `/v3/projects/9717263f7d4a452e9bf8dfa0907bda95/users/955fb91fe1bc4272b566b64ee4527121/roles/c163d39b46d24a27a76fb9026fec24ff` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:37.401622 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c160328-6fe2-4054-8c9d-b73773e0fb74 None admin] RBAC: Authorizing `identity:create_grant(project_id=9717263f7d4a452e9bf8dfa0907bda95, user_id=955fb91fe1bc4272b566b64ee4527121, role_id=c163d39b46d24a27a76fb9026fec24ff)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:37.403160 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c160328-6fe2-4054-8c9d-b73773e0fb74 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:37.429428 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 66/136] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 11:48:37 2022] PUT /identity/v3/projects/9717263f7d4a452e9bf8dfa0907bda95/users/955fb91fe1bc4272b566b64ee4527121/roles/c163d39b46d24a27a76fb9026fec24ff => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 11:48:37.455389 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae9313-1422-4c4f-9d2b-9021620a1741 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:37.536411 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e52fc-c757-451b-b442-b8af4fdda878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:37.537145 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e52fc-c757-451b-b442-b8af4fdda878 None admin] REQUEST_METHOD: `PUT` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:37.537432 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e52fc-c757-451b-b442-b8af4fdda878 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:37.537722 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e52fc-c757-451b-b442-b8af4fdda878 None admin] PATH_INFO: `/v3/projects/e6471a8fe6554c5aa0224d1bc08a702d/users/955fb91fe1bc4272b566b64ee4527121/roles/165db5ccce0540569e708b81df7a5577` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:37.542474 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e52fc-c757-451b-b442-b8af4fdda878 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6471a8fe6554c5aa0224d1bc08a702d, user_id=955fb91fe1bc4272b566b64ee4527121, role_id=165db5ccce0540569e708b81df7a5577)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:37.544627 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e52fc-c757-451b-b442-b8af4fdda878 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:37.570299 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 71/137] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 11:48:37 2022] PUT /identity/v3/projects/e6471a8fe6554c5aa0224d1bc08a702d/users/955fb91fe1bc4272b566b64ee4527121/roles/165db5ccce0540569e708b81df7a5577 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 11:48:37.713490 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1fff8-111b-48bb-8ce2-ae9ddafc3edf None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:37.713789 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1fff8-111b-48bb-8ce2-ae9ddafc3edf None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:37.713949 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1fff8-111b-48bb-8ce2-ae9ddafc3edf None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:37.716317 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 67/138] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:37.721881 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b8197-8b58-4697-a3f4-d16abebd6052 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:37.722515 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b8197-8b58-4697-a3f4-d16abebd6052 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:37.723002 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b8197-8b58-4697-a3f4-d16abebd6052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:37.754187 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-562b8197-8b58-4697-a3f4-d16abebd6052 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:37.755826 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-562b8197-8b58-4697-a3f4-d16abebd6052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:37.758528 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:37.812153 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174262bc-83ef-4e6e-a97d-f2243b923466 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:37.812513 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174262bc-83ef-4e6e-a97d-f2243b923466 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:37.812742 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174262bc-83ef-4e6e-a97d-f2243b923466 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:37.814808 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 68/139] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:37.822080 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fcacb-1665-44f8-9fa0-466bfb4f7114 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:37.822415 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fcacb-1665-44f8-9fa0-466bfb4f7114 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:37.822641 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fcacb-1665-44f8-9fa0-466bfb4f7114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:37.837910 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:37.853147 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-df5fcacb-1665-44f8-9fa0-466bfb4f7114 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:37.855675 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-df5fcacb-1665-44f8-9fa0-466bfb4f7114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:37.862403 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 72/140] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:48:37.948451 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 69/141] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:48:38.313618 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b8197-8b58-4697-a3f4-d16abebd6052 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:38.416176 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b8197-8b58-4697-a3f4-d16abebd6052 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:38.461237 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb55e7-0fd5-4b8d-ab58-dcbfce74e0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:38.462686 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb55e7-0fd5-4b8d-ab58-dcbfce74e0e0 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:38.463156 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb55e7-0fd5-4b8d-ab58-dcbfce74e0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:38.463616 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb55e7-0fd5-4b8d-ab58-dcbfce74e0e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:38.465023 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb55e7-0fd5-4b8d-ab58-dcbfce74e0e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:38.466659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb55e7-0fd5-4b8d-ab58-dcbfce74e0e0 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:38.468529 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 73/142] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:48:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:38.477058 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fcacb-1665-44f8-9fa0-466bfb4f7114 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:38.518566 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb55e7-0fd5-4b8d-ab58-dcbfce74e0e0 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:38.533841 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:38.700203 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fcacb-1665-44f8-9fa0-466bfb4f7114 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:38.737449 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb55e7-0fd5-4b8d-ab58-dcbfce74e0e0 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:38.776738 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de91661-d543-415d-882a-1b857b4e53db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:38.777882 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de91661-d543-415d-882a-1b857b4e53db None admin] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:38.778209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de91661-d543-415d-882a-1b857b4e53db None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:38.778420 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de91661-d543-415d-882a-1b857b4e53db None admin] PATH_INFO: `/v3/users` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:38.779070 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de91661-d543-415d-882a-1b857b4e53db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:38.780552 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de91661-d543-415d-882a-1b857b4e53db None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:38.807667 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:38.811496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239029d-b0d7-4060-9b1e-92ea1e4497dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:38.812473 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239029d-b0d7-4060-9b1e-92ea1e4497dd None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:38.812969 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239029d-b0d7-4060-9b1e-92ea1e4497dd None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:38.813427 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239029d-b0d7-4060-9b1e-92ea1e4497dd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:38.834975 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 70/143] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 21 11:48:38 2022] POST /identity/v3/users => generated 283 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 11:48:38.838607 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239029d-b0d7-4060-9b1e-92ea1e4497dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:48:38.845289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-1239029d-b0d7-4060-9b1e-92ea1e4497dd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 11:48:38.845289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:48:38.845289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:48:38.845289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:48:38.845289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:48:38.845289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:48:38.845289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:48:38.845289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:48:38.845289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:48:38.845289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:48:38.845289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:48:38.845289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:48:38.845289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:48:38.845289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:48:38.845289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:48:38.845289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:48:38.846212 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:48:38.846212 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:48:38.846212 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:48:38.846212 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:48:38.846212 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:48:38.846212 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:48:38.846212 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:48:38.846212 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:48:38.846212 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:48:38.846212 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:48:38.846212 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:48:38.846212 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:48:38.846212 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:48:38.846212 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:48:38.846212 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:48:38.846212 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:48:38.847071 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:48:38.847071 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:48:38.847071 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:48:38.847071 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:48:38.847071 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:48:38.847071 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:48:38.847071 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:48:38.847071 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:48:38.847071 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:48:38.847071 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:48:38.847071 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 11:48:38.847071 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:48:38.849818 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 74/144] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:48:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 11:48:38.856141 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de91661-d543-415d-882a-1b857b4e53db None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:39.004891 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de91661-d543-415d-882a-1b857b4e53db None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:39.052247 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b204fd-40f5-4dce-b9f9-51497a78fdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:39.052943 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b204fd-40f5-4dce-b9f9-51497a78fdc3 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:39.053228 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b204fd-40f5-4dce-b9f9-51497a78fdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:39.053502 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b204fd-40f5-4dce-b9f9-51497a78fdc3 None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:39.054190 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b204fd-40f5-4dce-b9f9-51497a78fdc3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:39.054495 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b204fd-40f5-4dce-b9f9-51497a78fdc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:39.055925 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b204fd-40f5-4dce-b9f9-51497a78fdc3 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:39.067835 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 71/145] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 11:48:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:39.073369 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239029d-b0d7-4060-9b1e-92ea1e4497dd None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:39.171572 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:39.218865 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239029d-b0d7-4060-9b1e-92ea1e4497dd None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:39.264760 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b724b2-549e-4488-81e4-e1d1411ac98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:39.265402 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b724b2-549e-4488-81e4-e1d1411ac98a None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:39.265743 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b724b2-549e-4488-81e4-e1d1411ac98a None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:39.266011 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b724b2-549e-4488-81e4-e1d1411ac98a None admin] PATH_INFO: `/v3/users/a691d755caaf42bf906cccf9a9b883ab` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:39.267224 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b724b2-549e-4488-81e4-e1d1411ac98a None admin] RBAC: Authorizing `identity:get_user(user_id=a691d755caaf42bf906cccf9a9b883ab)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:39.268709 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b724b2-549e-4488-81e4-e1d1411ac98a None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:39.270285 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 75/146] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:48:39 2022] GET /identity/v3/users/a691d755caaf42bf906cccf9a9b883ab => generated 289 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:39.275764 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b204fd-40f5-4dce-b9f9-51497a78fdc3 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:39.341621 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:39.392075 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b204fd-40f5-4dce-b9f9-51497a78fdc3 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:39.426806 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727b49a-a6ce-4656-be31-8d8497b3cf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:39.427362 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727b49a-a6ce-4656-be31-8d8497b3cf29 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:39.427758 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727b49a-a6ce-4656-be31-8d8497b3cf29 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:39.428057 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727b49a-a6ce-4656-be31-8d8497b3cf29 None admin] PATH_INFO: `/v3/projects/9717263f7d4a452e9bf8dfa0907bda95` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:39.429316 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727b49a-a6ce-4656-be31-8d8497b3cf29 None admin] RBAC: Authorizing `identity:get_project(project_id=9717263f7d4a452e9bf8dfa0907bda95)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:39.430823 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727b49a-a6ce-4656-be31-8d8497b3cf29 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:39.432907 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 72/147] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:48:39 2022] GET /identity/v3/projects/9717263f7d4a452e9bf8dfa0907bda95 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:39.438939 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b724b2-549e-4488-81e4-e1d1411ac98a None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:39.555115 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b724b2-549e-4488-81e4-e1d1411ac98a None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:39.595486 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6e08b-07fb-427f-8c93-43b1e54d6364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:39.596176 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6e08b-07fb-427f-8c93-43b1e54d6364 None admin] REQUEST_METHOD: `PUT` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:39.596453 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6e08b-07fb-427f-8c93-43b1e54d6364 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:39.596722 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6e08b-07fb-427f-8c93-43b1e54d6364 None admin] PATH_INFO: `/v3/projects/9717263f7d4a452e9bf8dfa0907bda95/users/a691d755caaf42bf906cccf9a9b883ab/roles/bc70cac1c1b444989feeffc53b52d9ae` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:39.601256 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6e08b-07fb-427f-8c93-43b1e54d6364 None admin] RBAC: Authorizing `identity:create_grant(project_id=9717263f7d4a452e9bf8dfa0907bda95, user_id=a691d755caaf42bf906cccf9a9b883ab, role_id=bc70cac1c1b444989feeffc53b52d9ae)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:39.602707 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6e08b-07fb-427f-8c93-43b1e54d6364 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:39.608397 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:39.623844 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 76/148] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 11:48:39 2022] PUT /identity/v3/projects/9717263f7d4a452e9bf8dfa0907bda95/users/a691d755caaf42bf906cccf9a9b883ab/roles/bc70cac1c1b444989feeffc53b52d9ae => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 11:48:40.653989 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79780844-a88a-462c-b08d-4cea2ad6b681 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:40.654489 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79780844-a88a-462c-b08d-4cea2ad6b681 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:40.654587 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79780844-a88a-462c-b08d-4cea2ad6b681 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:40.656282 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 73/149] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:40.661682 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba4732-8eef-4e2b-be80-68a64c127610 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:40.662532 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba4732-8eef-4e2b-be80-68a64c127610 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:40.662994 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba4732-8eef-4e2b-be80-68a64c127610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:40.687750 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-62ba4732-8eef-4e2b-be80-68a64c127610 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:40.689010 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-62ba4732-8eef-4e2b-be80-68a64c127610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:40.771660 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 77/150] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:48:40.826600 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c57567-de95-4e55-bd50-27ad7eff12ad None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:40.827228 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c57567-de95-4e55-bd50-27ad7eff12ad None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:40.827721 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c57567-de95-4e55-bd50-27ad7eff12ad None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:40.829309 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 74/151] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:40.835063 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe425a13-ee6d-419b-a7e7-debe8f6aa422 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:40.835341 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe425a13-ee6d-419b-a7e7-debe8f6aa422 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:40.835662 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe425a13-ee6d-419b-a7e7-debe8f6aa422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:40.856878 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-fe425a13-ee6d-419b-a7e7-debe8f6aa422 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:40.858056 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-fe425a13-ee6d-419b-a7e7-debe8f6aa422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:40.890068 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da42936-5637-423f-b7cd-137443b278ee None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:40.890707 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da42936-5637-423f-b7cd-137443b278ee None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:40.891156 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da42936-5637-423f-b7cd-137443b278ee None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:40.892743 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 75/152] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:40.907564 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070700ad-0d81-48dc-89e9-8a215c7469a0 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:40.907878 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070700ad-0d81-48dc-89e9-8a215c7469a0 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:40.908107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070700ad-0d81-48dc-89e9-8a215c7469a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:40.944616 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 78/153] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:48:40.948616 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-070700ad-0d81-48dc-89e9-8a215c7469a0 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:40.950761 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-070700ad-0d81-48dc-89e9-8a215c7469a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:41.048599 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 76/154] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 11:48:41.442790 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe425a13-ee6d-419b-a7e7-debe8f6aa422 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:41.511972 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:41.544810 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070700ad-0d81-48dc-89e9-8a215c7469a0 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:41.608593 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe425a13-ee6d-419b-a7e7-debe8f6aa422 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:41.649325 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:41.674563 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8f3a5-778d-48a8-9e7e-36063c1efb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:41.675939 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8f3a5-778d-48a8-9e7e-36063c1efb51 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:41.676504 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8f3a5-778d-48a8-9e7e-36063c1efb51 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:41.676967 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8f3a5-778d-48a8-9e7e-36063c1efb51 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:41.704994 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8f3a5-778d-48a8-9e7e-36063c1efb51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:48:41.710150 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-58b8f3a5-778d-48a8-9e7e-36063c1efb51 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 11:48:41.710150 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:48:41.710150 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:48:41.710150 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:48:41.710150 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:48:41.710150 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:48:41.710150 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:48:41.710150 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:48:41.710150 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:48:41.710150 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:48:41.710150 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:48:41.710150 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:48:41.710150 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:48:41.710150 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:48:41.710150 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:48:41.710150 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:48:41.711004 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:48:41.711004 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:48:41.711004 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:48:41.711004 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:48:41.711004 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:48:41.711004 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:48:41.711004 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:48:41.711004 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:48:41.711004 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:48:41.711004 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:48:41.711004 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:48:41.711004 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:48:41.711004 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:48:41.711004 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:48:41.711004 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:48:41.711004 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:48:41.711770 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:48:41.711770 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:48:41.711770 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:48:41.711770 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:48:41.711770 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:48:41.711770 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:48:41.711770 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:48:41.711770 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:48:41.711770 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:48:41.711770 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:48:41.711770 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 11:48:41.711770 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:48:41.719375 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 79/155] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 11:48:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:48:41.720560 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8f3a5-778d-48a8-9e7e-36063c1efb51 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:41.722880 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070700ad-0d81-48dc-89e9-8a215c7469a0 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:41.764460 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb832bd-1e30-4ac9-9bb7-8d57ccb20345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:41.766299 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb832bd-1e30-4ac9-9bb7-8d57ccb20345 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:41.766625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb832bd-1e30-4ac9-9bb7-8d57ccb20345 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:41.766898 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb832bd-1e30-4ac9-9bb7-8d57ccb20345 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:41.779499 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb832bd-1e30-4ac9-9bb7-8d57ccb20345 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:48:41.784407 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-cfb832bd-1e30-4ac9-9bb7-8d57ccb20345 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:48:41.784407 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:48:41.784407 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:48:41.784407 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:48:41.784407 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:48:41.784407 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:48:41.784407 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:48:41.784407 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:48:41.784407 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:48:41.784407 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:48:41.784407 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:48:41.784407 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:48:41.784407 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:48:41.784407 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:48:41.784407 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:48:41.784407 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:48:41.785437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:48:41.785437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:48:41.785437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:48:41.785437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:48:41.785437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:48:41.785437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:48:41.785437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:48:41.785437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:48:41.785437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:48:41.785437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:48:41.785437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:48:41.785437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:48:41.785437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:48:41.785437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:48:41.785437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:48:41.785437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:48:41.786373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:48:41.786373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:48:41.786373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:48:41.786373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:48:41.786373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:48:41.786373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:48:41.786373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:48:41.786373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:48:41.786373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:48:41.786373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:48:41.786373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:48:41.786373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:48:41.786373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 77/156] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:48:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:48:41.786373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb832bd-1e30-4ac9-9bb7-8d57ccb20345 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:41.897358 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb832bd-1e30-4ac9-9bb7-8d57ccb20345 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:41.912118 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:41.936892 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82c893-2a60-4313-b4ab-4994de8221b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:41.937529 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82c893-2a60-4313-b4ab-4994de8221b6 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:41.937806 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82c893-2a60-4313-b4ab-4994de8221b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:41.938075 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82c893-2a60-4313-b4ab-4994de8221b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:41.950810 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82c893-2a60-4313-b4ab-4994de8221b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:48:41.956067 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-8d82c893-2a60-4313-b4ab-4994de8221b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:48:41.956067 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:48:41.956067 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:48:41.956067 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:48:41.956067 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:48:41.956067 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:48:41.956067 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:48:41.956067 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:48:41.956067 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:48:41.956067 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:48:41.956067 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:48:41.956067 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:48:41.956067 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:48:41.956067 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:48:41.956067 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:48:41.956067 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:48:41.956963 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:48:41.956963 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:48:41.956963 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:48:41.956963 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:48:41.956963 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:48:41.956963 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:48:41.956963 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:48:41.956963 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:48:41.956963 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:48:41.956963 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:48:41.956963 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:48:41.956963 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:48:41.956963 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:48:41.956963 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:48:41.956963 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:48:41.956963 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:48:41.957757 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:48:41.957757 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:48:41.957757 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:48:41.957757 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:48:41.957757 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:48:41.957757 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:48:41.957757 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:48:41.957757 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:48:41.957757 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:48:41.957757 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:48:41.957757 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:48:41.957757 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:48:41.960537 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 78/157] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 11:48:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:48:41.961432 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82c893-2a60-4313-b4ab-4994de8221b6 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:41.977681 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8f3a5-778d-48a8-9e7e-36063c1efb51 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:42.016363 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:42.071136 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82c893-2a60-4313-b4ab-4994de8221b6 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:42.072691 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abffd8-68c4-46b7-a95f-76c8341524e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:42.073309 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abffd8-68c4-46b7-a95f-76c8341524e0 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:42.073585 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abffd8-68c4-46b7-a95f-76c8341524e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:42.073855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abffd8-68c4-46b7-a95f-76c8341524e0 None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:42.075114 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63abffd8-68c4-46b7-a95f-76c8341524e0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:42.075413 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63abffd8-68c4-46b7-a95f-76c8341524e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:42.076847 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63abffd8-68c4-46b7-a95f-76c8341524e0 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:42.092064 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 80/158] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:48:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:42.093340 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba388e-5d4f-478f-bd10-31433a513fd3 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:42.093620 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba388e-5d4f-478f-bd10-31433a513fd3 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:42.093888 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba388e-5d4f-478f-bd10-31433a513fd3 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:42.095233 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 81/159] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:42.095769 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba388e-5d4f-478f-bd10-31433a513fd3 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:42.108958 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59039306-e060-4b69-ad13-62d2733386f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:42.109570 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59039306-e060-4b69-ad13-62d2733386f5 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:42.109845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59039306-e060-4b69-ad13-62d2733386f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:42.110208 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59039306-e060-4b69-ad13-62d2733386f5 None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:42.110872 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59039306-e060-4b69-ad13-62d2733386f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:42.111221 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59039306-e060-4b69-ad13-62d2733386f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:42.112685 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59039306-e060-4b69-ad13-62d2733386f5 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:42.122863 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 79/160] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 11:48:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:42.124158 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f283b6-a836-4d38-848c-009fba131102 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:42.124448 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f283b6-a836-4d38-848c-009fba131102 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:42.124762 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f283b6-a836-4d38-848c-009fba131102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:42.143591 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-80f283b6-a836-4d38-848c-009fba131102 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:42.144800 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-80f283b6-a836-4d38-848c-009fba131102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:42.174752 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:42.217913 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 80/161] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:48:42.218622 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f283b6-a836-4d38-848c-009fba131102 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:42.298206 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba388e-5d4f-478f-bd10-31433a513fd3 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:42.355056 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f283b6-a836-4d38-848c-009fba131102 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:42.356677 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19668ba-a3b6-4480-9f5b-ea0f6ed3a8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:42.357296 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19668ba-a3b6-4480-9f5b-ea0f6ed3a8ef None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:42.357569 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19668ba-a3b6-4480-9f5b-ea0f6ed3a8ef None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:42.357837 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19668ba-a3b6-4480-9f5b-ea0f6ed3a8ef None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:42.358506 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19668ba-a3b6-4480-9f5b-ea0f6ed3a8ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:42.358809 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19668ba-a3b6-4480-9f5b-ea0f6ed3a8ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:42.360414 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19668ba-a3b6-4480-9f5b-ea0f6ed3a8ef None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:42.370144 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 82/162] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:48:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:42.370795 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19668ba-a3b6-4480-9f5b-ea0f6ed3a8ef None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:42.396890 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e48ff9-0330-4582-a875-1ff4daa6bc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:42.397531 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e48ff9-0330-4582-a875-1ff4daa6bc19 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:42.397859 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e48ff9-0330-4582-a875-1ff4daa6bc19 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:42.398136 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e48ff9-0330-4582-a875-1ff4daa6bc19 None admin] PATH_INFO: `/v3/users/955fb91fe1bc4272b566b64ee4527121` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:42.399277 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e48ff9-0330-4582-a875-1ff4daa6bc19 None admin] RBAC: Authorizing `identity:get_user(user_id=955fb91fe1bc4272b566b64ee4527121)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:42.400929 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e48ff9-0330-4582-a875-1ff4daa6bc19 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:42.402951 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 81/163] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:48:42 2022] GET /identity/v3/users/955fb91fe1bc4272b566b64ee4527121 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:42.403847 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e48ff9-0330-4582-a875-1ff4daa6bc19 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:42.448417 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:42.452462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:42.507922 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e48ff9-0330-4582-a875-1ff4daa6bc19 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:42.542693 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d8b1e-f78a-42d1-894c-a2e9a1a0c2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:42.543947 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d8b1e-f78a-42d1-894c-a2e9a1a0c2d4 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:42.544267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d8b1e-f78a-42d1-894c-a2e9a1a0c2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:42.544536 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d8b1e-f78a-42d1-894c-a2e9a1a0c2d4 None admin] PATH_INFO: `/v3/users/371d9f7c2d964f04b62c347e6b182e88` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:42.545671 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d8b1e-f78a-42d1-894c-a2e9a1a0c2d4 None admin] RBAC: Authorizing `identity:get_user(user_id=371d9f7c2d964f04b62c347e6b182e88)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:42.547120 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d8b1e-f78a-42d1-894c-a2e9a1a0c2d4 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:42.548551 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19668ba-a3b6-4480-9f5b-ea0f6ed3a8ef None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:42.549076 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 82/164] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:48:42 2022] GET /identity/v3/users/371d9f7c2d964f04b62c347e6b182e88 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:42.552737 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d8b1e-f78a-42d1-894c-a2e9a1a0c2d4 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:42.607924 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4ee67-a334-455f-a0ed-b5ada7841621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:42.608580 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4ee67-a334-455f-a0ed-b5ada7841621 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:42.608852 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4ee67-a334-455f-a0ed-b5ada7841621 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:42.609121 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4ee67-a334-455f-a0ed-b5ada7841621 None admin] PATH_INFO: `/v3/users/955fb91fe1bc4272b566b64ee4527121` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:42.610263 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4ee67-a334-455f-a0ed-b5ada7841621 None admin] RBAC: Authorizing `identity:get_user(user_id=955fb91fe1bc4272b566b64ee4527121)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:42.611711 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4ee67-a334-455f-a0ed-b5ada7841621 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:42.617527 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 83/165] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:48:42 2022] GET /identity/v3/users/955fb91fe1bc4272b566b64ee4527121 => generated 275 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:42.618107 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4ee67-a334-455f-a0ed-b5ada7841621 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:42.676534 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:42.681051 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d8b1e-f78a-42d1-894c-a2e9a1a0c2d4 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:42.742486 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4728d-dbc4-49a0-8675-e0d8cfe2de37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:42.743132 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4728d-dbc4-49a0-8675-e0d8cfe2de37 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:42.743354 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4728d-dbc4-49a0-8675-e0d8cfe2de37 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:42.743675 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4728d-dbc4-49a0-8675-e0d8cfe2de37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:42.811603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4ee67-a334-455f-a0ed-b5ada7841621 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:42.828411 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:42.849976 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca4728d-dbc4-49a0-8675-e0d8cfe2de37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:42.851831 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca4728d-dbc4-49a0-8675-e0d8cfe2de37 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:42.876888 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79a31a-a90e-4e7f-a7c7-7a7743e376d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:42.877507 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79a31a-a90e-4e7f-a7c7-7a7743e376d2 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:42.877783 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79a31a-a90e-4e7f-a7c7-7a7743e376d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:42.878050 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79a31a-a90e-4e7f-a7c7-7a7743e376d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:42.987115 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79a31a-a90e-4e7f-a7c7-7a7743e376d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:42.988635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79a31a-a90e-4e7f-a7c7-7a7743e376d2 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:43.044464 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:43.051217 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 83/166] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:48:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:48:43.052370 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4728d-dbc4-49a0-8675-e0d8cfe2de37 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:43.156840 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 84/167] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:48:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:48:43.161659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79a31a-a90e-4e7f-a7c7-7a7743e376d2 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:43.172313 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:43.230532 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4728d-dbc4-49a0-8675-e0d8cfe2de37 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:43.273875 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba17ea-324d-47bb-84a7-2fe591080b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:43.274675 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba17ea-324d-47bb-84a7-2fe591080b39 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:43.275051 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba17ea-324d-47bb-84a7-2fe591080b39 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:43.275420 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba17ea-324d-47bb-84a7-2fe591080b39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:43.323860 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79a31a-a90e-4e7f-a7c7-7a7743e376d2 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:43.351724 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:43.357742 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba17ea-324d-47bb-84a7-2fe591080b39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:43.359427 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba17ea-324d-47bb-84a7-2fe591080b39 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:43.393275 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd73de-7c3e-4768-80eb-dce51127d162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:43.393908 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd73de-7c3e-4768-80eb-dce51127d162 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:43.394181 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd73de-7c3e-4768-80eb-dce51127d162 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:43.394445 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd73de-7c3e-4768-80eb-dce51127d162 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:43.420177 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd73de-7c3e-4768-80eb-dce51127d162 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:48:43.427292 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-90cd73de-7c3e-4768-80eb-dce51127d162 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:48:43.427292 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:48:43.427292 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:48:43.427292 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:48:43.427292 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:48:43.427292 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:48:43.427292 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:48:43.427292 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:48:43.427292 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:48:43.427292 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:48:43.427292 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:48:43.427292 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:48:43.427292 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:48:43.427292 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:48:43.427292 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:48:43.427292 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:48:43.428202 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:48:43.428202 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:48:43.428202 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:48:43.428202 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:48:43.428202 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:48:43.428202 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:48:43.428202 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:48:43.428202 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:48:43.428202 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:48:43.428202 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:48:43.428202 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:48:43.428202 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:48:43.428202 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:48:43.428202 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:48:43.428202 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:48:43.428202 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:48:43.429021 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:48:43.429021 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:48:43.429021 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:48:43.429021 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:48:43.429021 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:48:43.429021 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:48:43.429021 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:48:43.429021 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:48:43.429021 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:48:43.429021 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:48:43.429021 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:48:43.429021 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:48:43.434595 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 85/168] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:48:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:48:43.436850 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd73de-7c3e-4768-80eb-dce51127d162 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:43.523442 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 84/169] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:48:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:48:43.528224 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba17ea-324d-47bb-84a7-2fe591080b39 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:43.587703 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:43.648797 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd73de-7c3e-4768-80eb-dce51127d162 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:43.716798 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62626dc2-e2ab-4aab-b1b2-fef184c231b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:43.717767 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62626dc2-e2ab-4aab-b1b2-fef184c231b6 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:43.718389 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62626dc2-e2ab-4aab-b1b2-fef184c231b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:43.719878 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62626dc2-e2ab-4aab-b1b2-fef184c231b6 None admin] PATH_INFO: `/v3/projects/9717263f7d4a452e9bf8dfa0907bda95` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:43.722015 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62626dc2-e2ab-4aab-b1b2-fef184c231b6 None admin] RBAC: Authorizing `identity:get_project(project_id=9717263f7d4a452e9bf8dfa0907bda95)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:43.722535 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:43.725652 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62626dc2-e2ab-4aab-b1b2-fef184c231b6 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:43.729385 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba17ea-324d-47bb-84a7-2fe591080b39 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:43.732205 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 86/170] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:48:43 2022] GET /identity/v3/projects/9717263f7d4a452e9bf8dfa0907bda95 => generated 298 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:43.733271 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62626dc2-e2ab-4aab-b1b2-fef184c231b6 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:43.801599 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d53d1-6279-4099-b5b1-106528d04710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:43.802972 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d53d1-6279-4099-b5b1-106528d04710 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:43.803441 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d53d1-6279-4099-b5b1-106528d04710 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:43.803899 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d53d1-6279-4099-b5b1-106528d04710 None admin] PATH_INFO: `/v3/projects/9717263f7d4a452e9bf8dfa0907bda95` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:43.805292 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d53d1-6279-4099-b5b1-106528d04710 None admin] RBAC: Authorizing `identity:get_project(project_id=9717263f7d4a452e9bf8dfa0907bda95)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:43.807045 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d53d1-6279-4099-b5b1-106528d04710 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:43.809098 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 85/171] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:48:43 2022] GET /identity/v3/projects/9717263f7d4a452e9bf8dfa0907bda95 => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:43.815067 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d53d1-6279-4099-b5b1-106528d04710 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:43.863121 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62626dc2-e2ab-4aab-b1b2-fef184c231b6 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:43.899340 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66bb3ea-502f-463d-9c59-80aa042d13c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:43.900055 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bb3ea-502f-463d-9c59-80aa042d13c1 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:43.900341 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bb3ea-502f-463d-9c59-80aa042d13c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:43.900610 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bb3ea-502f-463d-9c59-80aa042d13c1 None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:43.901269 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66bb3ea-502f-463d-9c59-80aa042d13c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:43.901567 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66bb3ea-502f-463d-9c59-80aa042d13c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:43.903032 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66bb3ea-502f-463d-9c59-80aa042d13c1 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:43.904645 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:43.913667 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 87/172] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 11:48:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:43.914651 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66bb3ea-502f-463d-9c59-80aa042d13c1 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:44.005234 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d53d1-6279-4099-b5b1-106528d04710 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:44.034357 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66bb3ea-502f-463d-9c59-80aa042d13c1 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:44.041038 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3e712-9b2a-411e-8cd8-3b3b6ab2af2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:44.041938 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3e712-9b2a-411e-8cd8-3b3b6ab2af2f None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:44.042215 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3e712-9b2a-411e-8cd8-3b3b6ab2af2f None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:44.042486 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3e712-9b2a-411e-8cd8-3b3b6ab2af2f None admin] PATH_INFO: `/v3/projects/9717263f7d4a452e9bf8dfa0907bda95` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:44.044333 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3e712-9b2a-411e-8cd8-3b3b6ab2af2f None admin] RBAC: Authorizing `identity:get_project(project_id=9717263f7d4a452e9bf8dfa0907bda95)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:44.045889 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3e712-9b2a-411e-8cd8-3b3b6ab2af2f None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:44.047804 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 86/173] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:48:43 2022] GET /identity/v3/projects/9717263f7d4a452e9bf8dfa0907bda95 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:44.052683 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3e712-9b2a-411e-8cd8-3b3b6ab2af2f None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:44.081074 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62c9cd-f710-4534-ad73-f598313f1c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:44.081677 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62c9cd-f710-4534-ad73-f598313f1c43 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:44.082111 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62c9cd-f710-4534-ad73-f598313f1c43 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:44.082378 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62c9cd-f710-4534-ad73-f598313f1c43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:44.083670 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62c9cd-f710-4534-ad73-f598313f1c43 None admin] RBAC: Adding query filter params (role.id=c163d39b46d24a27a76fb9026fec24ff, scope.project.id=9717263f7d4a452e9bf8dfa0907bda95, user.id=955fb91fe1bc4272b566b64ee4527121) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:44.084135 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62c9cd-f710-4534-ad73-f598313f1c43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:44.086072 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62c9cd-f710-4534-ad73-f598313f1c43 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:44.094232 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 88/174] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 11:48:43 2022] GET /identity/v3/role_assignments?user.id=955fb91fe1bc4272b566b64ee4527121&scope.project.id=9717263f7d4a452e9bf8dfa0907bda95&role.id=c163d39b46d24a27a76fb9026fec24ff => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:44.095112 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62c9cd-f710-4534-ad73-f598313f1c43 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:44.100404 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:44.208526 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3e712-9b2a-411e-8cd8-3b3b6ab2af2f None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:44.219552 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:44.276314 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62c9cd-f710-4534-ad73-f598313f1c43 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:44.300649 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ef037-c43b-4986-a1db-aff4f45c8002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:44.308026 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ef037-c43b-4986-a1db-aff4f45c8002 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:44.308026 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ef037-c43b-4986-a1db-aff4f45c8002 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:44.308026 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ef037-c43b-4986-a1db-aff4f45c8002 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:44.308026 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ef037-c43b-4986-a1db-aff4f45c8002 None admin] RBAC: Adding query filter params (role.id=d1f3d1431da145709a5e9b374f3b403d, scope.project.id=9717263f7d4a452e9bf8dfa0907bda95, user.id=371d9f7c2d964f04b62c347e6b182e88) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:44.308026 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ef037-c43b-4986-a1db-aff4f45c8002 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:44.308026 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ef037-c43b-4986-a1db-aff4f45c8002 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:44.315433 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 87/175] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 11:48:44 2022] GET /identity/v3/role_assignments?user.id=371d9f7c2d964f04b62c347e6b182e88&scope.project.id=9717263f7d4a452e9bf8dfa0907bda95&role.id=d1f3d1431da145709a5e9b374f3b403d => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:44.315433 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a92e6-2419-44fd-9ab9-ffea41a9e797 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:44.315433 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a92e6-2419-44fd-9ab9-ffea41a9e797 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:44.315433 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a92e6-2419-44fd-9ab9-ffea41a9e797 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:44.316160 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 88/176] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:44.317380 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a92e6-2419-44fd-9ab9-ffea41a9e797 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:44.357745 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b8041-49ca-451b-865a-428b16ea67ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:44.358770 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b8041-49ca-451b-865a-428b16ea67ce None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:44.359243 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b8041-49ca-451b-865a-428b16ea67ce None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:44.359708 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b8041-49ca-451b-865a-428b16ea67ce None admin] PATH_INFO: `/v3/users/955fb91fe1bc4272b566b64ee4527121` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:44.364878 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b8041-49ca-451b-865a-428b16ea67ce None admin] RBAC: Authorizing `identity:get_user(user_id=955fb91fe1bc4272b566b64ee4527121)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:44.366699 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b8041-49ca-451b-865a-428b16ea67ce None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:44.368641 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 89/177] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:48:44 2022] GET /identity/v3/users/955fb91fe1bc4272b566b64ee4527121 => generated 275 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:44.370085 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c246a-a455-4ab4-a18c-4d73efc81b71 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:44.370582 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c246a-a455-4ab4-a18c-4d73efc81b71 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:44.371120 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c246a-a455-4ab4-a18c-4d73efc81b71 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:44.372709 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 90/178] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:44.374074 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affba597-37e5-4cb0-b8d9-2d98c5c69749 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:44.380018 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affba597-37e5-4cb0-b8d9-2d98c5c69749 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:44.380784 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affba597-37e5-4cb0-b8d9-2d98c5c69749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:44.415158 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-affba597-37e5-4cb0-b8d9-2d98c5c69749 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:44.417075 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-affba597-37e5-4cb0-b8d9-2d98c5c69749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:44.457055 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:44.463273 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a92e6-2419-44fd-9ab9-ffea41a9e797 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:44.505082 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4850bc-16c9-4fac-a8ff-c2fec9412413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:44.505741 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4850bc-16c9-4fac-a8ff-c2fec9412413 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:44.506018 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4850bc-16c9-4fac-a8ff-c2fec9412413 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:44.506288 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4850bc-16c9-4fac-a8ff-c2fec9412413 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:44.507022 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4850bc-16c9-4fac-a8ff-c2fec9412413 None admin] RBAC: Adding query filter params (role.id=165db5ccce0540569e708b81df7a5577, scope.project.id=9717263f7d4a452e9bf8dfa0907bda95, user.id=955fb91fe1bc4272b566b64ee4527121) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:44.507322 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4850bc-16c9-4fac-a8ff-c2fec9412413 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:44.508871 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4850bc-16c9-4fac-a8ff-c2fec9412413 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:44.516724 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 89/179] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 11:48:44 2022] GET /identity/v3/role_assignments?user.id=955fb91fe1bc4272b566b64ee4527121&scope.project.id=9717263f7d4a452e9bf8dfa0907bda95&role.id=165db5ccce0540569e708b81df7a5577 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:44.517826 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7c4dd-5ff7-4848-983c-7ce4d16794d2 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:44.518104 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7c4dd-5ff7-4848-983c-7ce4d16794d2 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:44.518372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7c4dd-5ff7-4848-983c-7ce4d16794d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:44.539522 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-42f7c4dd-5ff7-4848-983c-7ce4d16794d2 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:44.540904 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-42f7c4dd-5ff7-4848-983c-7ce4d16794d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:44.562526 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 91/180] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:48:44.563773 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affba597-37e5-4cb0-b8d9-2d98c5c69749 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:44.624093 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 90/181] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:48:44.676602 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:44.731513 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affba597-37e5-4cb0-b8d9-2d98c5c69749 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:44.778802 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42951e99-f7b4-424c-81ee-c4c7c8a12cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:44.779408 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42951e99-f7b4-424c-81ee-c4c7c8a12cdb None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:44.779676 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42951e99-f7b4-424c-81ee-c4c7c8a12cdb None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:44.779939 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42951e99-f7b4-424c-81ee-c4c7c8a12cdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:44.865074 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42951e99-f7b4-424c-81ee-c4c7c8a12cdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:44.866451 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42951e99-f7b4-424c-81ee-c4c7c8a12cdb None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:44.938989 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:44.993983 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 92/182] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:48:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:48:45.000720 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7c4dd-5ff7-4848-983c-7ce4d16794d2 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:45.038296 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42951e99-f7b4-424c-81ee-c4c7c8a12cdb None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:45.127216 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:45.136330 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7c4dd-5ff7-4848-983c-7ce4d16794d2 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:45.176379 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874bbae-1427-4f82-a1a0-0196c32f5979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:45.177334 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874bbae-1427-4f82-a1a0-0196c32f5979 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:45.177801 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874bbae-1427-4f82-a1a0-0196c32f5979 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:45.178263 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874bbae-1427-4f82-a1a0-0196c32f5979 None admin] PATH_INFO: `/v3/projects/e6471a8fe6554c5aa0224d1bc08a702d` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:45.179553 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874bbae-1427-4f82-a1a0-0196c32f5979 None admin] RBAC: Authorizing `identity:get_project(project_id=e6471a8fe6554c5aa0224d1bc08a702d)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:45.181172 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874bbae-1427-4f82-a1a0-0196c32f5979 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:45.182978 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 91/183] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:48:44 2022] GET /identity/v3/projects/e6471a8fe6554c5aa0224d1bc08a702d => generated 312 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:45.193013 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874bbae-1427-4f82-a1a0-0196c32f5979 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:45.234958 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42951e99-f7b4-424c-81ee-c4c7c8a12cdb None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:45.280873 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a0827-d925-43ef-9479-5ac8b3a1a350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:45.281816 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a0827-d925-43ef-9479-5ac8b3a1a350 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:45.282232 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a0827-d925-43ef-9479-5ac8b3a1a350 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:45.282641 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a0827-d925-43ef-9479-5ac8b3a1a350 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:45.295895 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a0827-d925-43ef-9479-5ac8b3a1a350 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:48:45.300729 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-fd0a0827-d925-43ef-9479-5ac8b3a1a350 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 11:48:45.300729 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:48:45.300729 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:48:45.300729 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:48:45.300729 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:48:45.300729 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:48:45.300729 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:48:45.300729 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:48:45.300729 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:48:45.300729 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:48:45.300729 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:48:45.300729 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:48:45.300729 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:48:45.300729 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:48:45.300729 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:48:45.300729 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:48:45.301608 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:48:45.301608 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:48:45.301608 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:48:45.301608 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:48:45.301608 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:48:45.301608 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:48:45.301608 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:48:45.301608 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:48:45.301608 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:48:45.301608 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:48:45.301608 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:48:45.301608 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:48:45.301608 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:48:45.301608 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:48:45.301608 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:48:45.301608 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:48:45.302405 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:48:45.302405 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:48:45.302405 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:48:45.302405 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:48:45.302405 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:48:45.302405 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:48:45.302405 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:48:45.302405 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:48:45.302405 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:48:45.302405 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:48:45.302405 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 11:48:45.302405 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:48:45.302405 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 93/184] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:48:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 11:48:45.303380 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecc96d-d2ec-4633-b2df-ae9ff46bac01 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:45.303815 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecc96d-d2ec-4633-b2df-ae9ff46bac01 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:45.304195 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecc96d-d2ec-4633-b2df-ae9ff46bac01 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:45.305973 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 94/185] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:45.311673 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5df507-b82e-4655-a6ec-0c2428d346b3 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:45.311673 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5df507-b82e-4655-a6ec-0c2428d346b3 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:45.311673 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5df507-b82e-4655-a6ec-0c2428d346b3 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:45.311673 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 95/186] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:45.311673 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5df507-b82e-4655-a6ec-0c2428d346b3 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:45.322774 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874bbae-1427-4f82-a1a0-0196c32f5979 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:45.330717 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:45.358700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef0413-1640-418f-ac7d-62f0efb1d7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:45.359298 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef0413-1640-418f-ac7d-62f0efb1d7f6 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:45.359572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef0413-1640-418f-ac7d-62f0efb1d7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:45.359841 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef0413-1640-418f-ac7d-62f0efb1d7f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:45.360768 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef0413-1640-418f-ac7d-62f0efb1d7f6 None admin] RBAC: Adding query filter params (role.id=165db5ccce0540569e708b81df7a5577, scope.project.id=e6471a8fe6554c5aa0224d1bc08a702d, user.id=955fb91fe1bc4272b566b64ee4527121) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:45.361414 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef0413-1640-418f-ac7d-62f0efb1d7f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:45.362891 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef0413-1640-418f-ac7d-62f0efb1d7f6 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:45.368834 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 92/187] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 11:48:45 2022] GET /identity/v3/role_assignments?user.id=955fb91fe1bc4272b566b64ee4527121&scope.project.id=e6471a8fe6554c5aa0224d1bc08a702d&role.id=165db5ccce0540569e708b81df7a5577 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:45.378572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef0413-1640-418f-ac7d-62f0efb1d7f6 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:45.401338 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:45.431030 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5df507-b82e-4655-a6ec-0c2428d346b3 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:45.471464 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b55280-c77a-462b-9324-82c2f59ad674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:45.472115 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b55280-c77a-462b-9324-82c2f59ad674 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:45.472394 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b55280-c77a-462b-9324-82c2f59ad674 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:45.472664 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b55280-c77a-462b-9324-82c2f59ad674 None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:45.473337 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b55280-c77a-462b-9324-82c2f59ad674 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:45.473628 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b55280-c77a-462b-9324-82c2f59ad674 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:45.475032 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b55280-c77a-462b-9324-82c2f59ad674 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:45.489163 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 96/188] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 11:48:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:45.489163 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bd87f-bf40-4bba-a286-b8d889173370 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:45.489163 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bd87f-bf40-4bba-a286-b8d889173370 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:45.489163 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bd87f-bf40-4bba-a286-b8d889173370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:45.498980 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef0413-1640-418f-ac7d-62f0efb1d7f6 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:45.505615 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-cc8bd87f-bf40-4bba-a286-b8d889173370 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:45.506843 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-cc8bd87f-bf40-4bba-a286-b8d889173370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:45.537595 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6967635-27ac-4190-8e3f-73f694d83f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:45.538242 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6967635-27ac-4190-8e3f-73f694d83f61 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:45.538516 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6967635-27ac-4190-8e3f-73f694d83f61 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:45.538777 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6967635-27ac-4190-8e3f-73f694d83f61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:45.551468 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6967635-27ac-4190-8e3f-73f694d83f61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:48:45.556936 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-a6967635-27ac-4190-8e3f-73f694d83f61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:48:45.556936 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:48:45.556936 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:48:45.556936 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:48:45.556936 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:48:45.556936 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:48:45.556936 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:48:45.556936 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:48:45.556936 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:48:45.556936 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:48:45.556936 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:48:45.556936 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:48:45.556936 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:48:45.556936 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:48:45.556936 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:48:45.556936 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:48:45.557910 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:48:45.557910 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:48:45.557910 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:48:45.557910 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:48:45.557910 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:48:45.557910 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:48:45.557910 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:48:45.557910 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:48:45.557910 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:48:45.557910 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:48:45.557910 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:48:45.557910 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:48:45.557910 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:48:45.557910 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:48:45.557910 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:48:45.557910 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:48:45.558755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:48:45.558755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:48:45.558755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:48:45.558755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:48:45.558755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:48:45.558755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:48:45.558755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:48:45.558755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:48:45.558755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:48:45.558755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:48:45.558755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:48:45.558755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:48:45.558755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 93/189] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 11:48:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:48:45.564451 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c54a1-c2ad-4d5c-a382-5f61b77fbaf4 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:45.564739 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c54a1-c2ad-4d5c-a382-5f61b77fbaf4 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:45.565005 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c54a1-c2ad-4d5c-a382-5f61b77fbaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:45.581382 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 97/190] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:48:45.582853 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bd87f-bf40-4bba-a286-b8d889173370 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:45.583576 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-6f9c54a1-c2ad-4d5c-a382-5f61b77fbaf4 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:45.584786 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-6f9c54a1-c2ad-4d5c-a382-5f61b77fbaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:45.604214 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:45.667246 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 94/191] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:48:45.668692 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c54a1-c2ad-4d5c-a382-5f61b77fbaf4 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:45.688555 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:45.735409 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bd87f-bf40-4bba-a286-b8d889173370 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:45.782804 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a344bde-43a2-4e7d-80b1-09522bde06f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:45.784405 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a344bde-43a2-4e7d-80b1-09522bde06f3 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:45.784569 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c54a1-c2ad-4d5c-a382-5f61b77fbaf4 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:45.785221 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a344bde-43a2-4e7d-80b1-09522bde06f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:45.785707 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a344bde-43a2-4e7d-80b1-09522bde06f3 None admin] PATH_INFO: `/v3/users/a691d755caaf42bf906cccf9a9b883ab` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:45.788723 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a344bde-43a2-4e7d-80b1-09522bde06f3 None admin] RBAC: Authorizing `identity:get_user(user_id=a691d755caaf42bf906cccf9a9b883ab)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:45.790434 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a344bde-43a2-4e7d-80b1-09522bde06f3 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:45.792573 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 98/192] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:48:45 2022] GET /identity/v3/users/a691d755caaf42bf906cccf9a9b883ab => generated 289 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:45.798168 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a344bde-43a2-4e7d-80b1-09522bde06f3 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:45.826076 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4b714-b535-4759-9435-ba4a8c5df458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:45.826729 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4b714-b535-4759-9435-ba4a8c5df458 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:45.827002 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4b714-b535-4759-9435-ba4a8c5df458 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:45.827266 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4b714-b535-4759-9435-ba4a8c5df458 None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:45.827919 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4b714-b535-4759-9435-ba4a8c5df458 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:45.828242 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4b714-b535-4759-9435-ba4a8c5df458 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:45.829644 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4b714-b535-4759-9435-ba4a8c5df458 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:45.838095 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 95/193] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:48:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:45.843675 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4b714-b535-4759-9435-ba4a8c5df458 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:45.924458 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:45.936684 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a344bde-43a2-4e7d-80b1-09522bde06f3 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:45.936888 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:45.962596 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4b714-b535-4759-9435-ba4a8c5df458 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:45.971060 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646ee71-23ad-4a74-847d-5234b24e3ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:45.971916 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646ee71-23ad-4a74-847d-5234b24e3ea7 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:45.972291 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646ee71-23ad-4a74-847d-5234b24e3ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:45.972628 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646ee71-23ad-4a74-847d-5234b24e3ea7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:45.999742 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163bcb5c-80de-4bc2-85db-f3cf99f3ba6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:46.000397 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bcb5c-80de-4bc2-85db-f3cf99f3ba6b None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:46.000671 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bcb5c-80de-4bc2-85db-f3cf99f3ba6b None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:46.000937 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bcb5c-80de-4bc2-85db-f3cf99f3ba6b None admin] PATH_INFO: `/v3/users/6dbe397b3f204f30bb9e5c70b4e474f2` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:46.015424 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163bcb5c-80de-4bc2-85db-f3cf99f3ba6b None admin] RBAC: Authorizing `identity:get_user(user_id=6dbe397b3f204f30bb9e5c70b4e474f2)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:46.017268 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163bcb5c-80de-4bc2-85db-f3cf99f3ba6b None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:46.019201 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 96/194] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:48:45 2022] GET /identity/v3/users/6dbe397b3f204f30bb9e5c70b4e474f2 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:48:46.019969 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163bcb5c-80de-4bc2-85db-f3cf99f3ba6b None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:46.044513 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646ee71-23ad-4a74-847d-5234b24e3ea7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:46.045991 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646ee71-23ad-4a74-847d-5234b24e3ea7 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:46.121954 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:46.122142 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163bcb5c-80de-4bc2-85db-f3cf99f3ba6b None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:46.143917 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 99/195] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:48:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 21 11:48:46.144750 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646ee71-23ad-4a74-847d-5234b24e3ea7 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:46.155762 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b9b48-55ed-4ca2-9d96-3cf8d2fde5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:46.156416 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b9b48-55ed-4ca2-9d96-3cf8d2fde5aa None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:46.156691 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b9b48-55ed-4ca2-9d96-3cf8d2fde5aa None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:46.156966 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b9b48-55ed-4ca2-9d96-3cf8d2fde5aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:46.159548 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:46.168596 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b9b48-55ed-4ca2-9d96-3cf8d2fde5aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:48:46.173313 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-836b9b48-55ed-4ca2-9d96-3cf8d2fde5aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 11:48:46.173313 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:48:46.173313 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:48:46.173313 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:48:46.173313 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:48:46.173313 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:48:46.173313 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:48:46.173313 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:48:46.173313 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:48:46.173313 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:48:46.173313 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:48:46.173313 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:48:46.173313 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:48:46.173313 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:48:46.173313 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:48:46.173313 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:48:46.174381 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:48:46.174381 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:48:46.174381 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:48:46.174381 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:48:46.174381 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:48:46.174381 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:48:46.174381 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:48:46.174381 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:48:46.174381 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:48:46.174381 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:48:46.174381 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:48:46.174381 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:48:46.174381 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:48:46.174381 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:48:46.174381 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:48:46.174381 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:48:46.175511 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:48:46.175511 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:48:46.175511 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:48:46.175511 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:48:46.175511 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:48:46.175511 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:48:46.175511 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:48:46.175511 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:48:46.175511 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:48:46.175511 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:48:46.175511 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 11:48:46.175511 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:48:46.175511 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 97/196] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 11:48:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:48:46.175511 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b9b48-55ed-4ca2-9d96-3cf8d2fde5aa None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:46.247048 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646ee71-23ad-4a74-847d-5234b24e3ea7 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:46.274616 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b9b48-55ed-4ca2-9d96-3cf8d2fde5aa None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:46.281122 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20006ccb-6b32-4788-afb2-35d8e744bf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:46.281718 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20006ccb-6b32-4788-afb2-35d8e744bf2f None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:46.281992 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20006ccb-6b32-4788-afb2-35d8e744bf2f None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:46.282259 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20006ccb-6b32-4788-afb2-35d8e744bf2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:46.308565 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5ab3b-8a12-4d9b-b4c0-22de8952b182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:46.309183 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5ab3b-8a12-4d9b-b4c0-22de8952b182 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:46.309453 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5ab3b-8a12-4d9b-b4c0-22de8952b182 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:46.309719 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5ab3b-8a12-4d9b-b4c0-22de8952b182 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:46.310811 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5ab3b-8a12-4d9b-b4c0-22de8952b182 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:46.312288 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5ab3b-8a12-4d9b-b4c0-22de8952b182 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:46.313998 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 98/197] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:48:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:46.314577 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5ab3b-8a12-4d9b-b4c0-22de8952b182 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:46.330613 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:46.354079 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20006ccb-6b32-4788-afb2-35d8e744bf2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:46.359303 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20006ccb-6b32-4788-afb2-35d8e744bf2f None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:46.380768 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:46.424629 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5ab3b-8a12-4d9b-b4c0-22de8952b182 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:46.457611 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b35eaf-ea46-4811-a115-c922ec9d4bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:46.458153 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b35eaf-ea46-4811-a115-c922ec9d4bac None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:46.458424 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b35eaf-ea46-4811-a115-c922ec9d4bac None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:46.458688 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b35eaf-ea46-4811-a115-c922ec9d4bac None admin] PATH_INFO: `/v3/projects/9717263f7d4a452e9bf8dfa0907bda95` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:46.459813 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b35eaf-ea46-4811-a115-c922ec9d4bac None admin] RBAC: Authorizing `identity:get_project(project_id=9717263f7d4a452e9bf8dfa0907bda95)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:46.460388 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 100/198] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:48:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:48:46.461220 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20006ccb-6b32-4788-afb2-35d8e744bf2f None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:46.461340 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b35eaf-ea46-4811-a115-c922ec9d4bac None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:46.463225 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 99/199] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:48:46 2022] GET /identity/v3/projects/9717263f7d4a452e9bf8dfa0907bda95 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:46.463951 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b35eaf-ea46-4811-a115-c922ec9d4bac None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:46.538438 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:46.560497 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20006ccb-6b32-4788-afb2-35d8e744bf2f None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:46.565897 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b35eaf-ea46-4811-a115-c922ec9d4bac None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:46.594273 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50ad9b-4d71-4fef-884a-f584cb734a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:46.595032 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50ad9b-4d71-4fef-884a-f584cb734a5a None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:46.595303 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50ad9b-4d71-4fef-884a-f584cb734a5a None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:46.595566 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50ad9b-4d71-4fef-884a-f584cb734a5a None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:46.595978 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:46.596261 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af50ad9b-4d71-4fef-884a-f584cb734a5a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:46.596637 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af50ad9b-4d71-4fef-884a-f584cb734a5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:46.598145 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af50ad9b-4d71-4fef-884a-f584cb734a5a None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:46.601872 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab228f-9c2d-43cd-af57-f5c71b23e925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:46.602470 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab228f-9c2d-43cd-af57-f5c71b23e925 None admin] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:46.602744 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab228f-9c2d-43cd-af57-f5c71b23e925 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:46.603014 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab228f-9c2d-43cd-af57-f5c71b23e925 None admin] PATH_INFO: `/v3/users` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:46.603659 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab228f-9c2d-43cd-af57-f5c71b23e925 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:46.605180 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab228f-9c2d-43cd-af57-f5c71b23e925 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:46.606875 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 101/200] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:48:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:46.611734 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50ad9b-4d71-4fef-884a-f584cb734a5a None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:46.636999 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 100/201] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 21 11:48:46 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 11:48:46.636999 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab228f-9c2d-43cd-af57-f5c71b23e925 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:46.735298 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50ad9b-4d71-4fef-884a-f584cb734a5a None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:46.753035 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab228f-9c2d-43cd-af57-f5c71b23e925 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:46.774021 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e271f-3ddc-489e-a237-601f012c4b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:46.774653 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e271f-3ddc-489e-a237-601f012c4b6a None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:46.774923 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e271f-3ddc-489e-a237-601f012c4b6a None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:46.775188 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e271f-3ddc-489e-a237-601f012c4b6a None admin] PATH_INFO: `/v3/projects/266db3a9097e4be4adb44df90ab84a02` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:46.776385 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e271f-3ddc-489e-a237-601f012c4b6a None admin] RBAC: Authorizing `identity:get_project(project_id=266db3a9097e4be4adb44df90ab84a02)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:46.778410 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e271f-3ddc-489e-a237-601f012c4b6a None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:46.781305 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 102/202] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:48:46 2022] GET /identity/v3/projects/266db3a9097e4be4adb44df90ab84a02 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:46.781305 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e271f-3ddc-489e-a237-601f012c4b6a None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:46.793009 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:46.802225 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a5bc7-e5dd-4cfd-aeda-3822b816bf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:46.802870 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a5bc7-e5dd-4cfd-aeda-3822b816bf1a None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:46.803107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a5bc7-e5dd-4cfd-aeda-3822b816bf1a None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:46.803380 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a5bc7-e5dd-4cfd-aeda-3822b816bf1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:46.804166 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a5bc7-e5dd-4cfd-aeda-3822b816bf1a None admin] RBAC: Adding query filter params (role.id=bc70cac1c1b444989feeffc53b52d9ae, scope.project.id=9717263f7d4a452e9bf8dfa0907bda95, user.id=a691d755caaf42bf906cccf9a9b883ab) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:46.804472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a5bc7-e5dd-4cfd-aeda-3822b816bf1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:46.805999 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a5bc7-e5dd-4cfd-aeda-3822b816bf1a None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:46.812722 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 101/203] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 11:48:46 2022] GET /identity/v3/role_assignments?user.id=a691d755caaf42bf906cccf9a9b883ab&scope.project.id=9717263f7d4a452e9bf8dfa0907bda95&role.id=bc70cac1c1b444989feeffc53b52d9ae => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:46.813566 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a5bc7-e5dd-4cfd-aeda-3822b816bf1a None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:46.897886 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:46.921040 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e271f-3ddc-489e-a237-601f012c4b6a None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:46.967051 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d253320-267a-4bd7-9da8-f186dc78179f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:46.967682 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d253320-267a-4bd7-9da8-f186dc78179f None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:46.967959 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d253320-267a-4bd7-9da8-f186dc78179f None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:46.968276 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d253320-267a-4bd7-9da8-f186dc78179f None admin] PATH_INFO: `/v3/users/6dbe397b3f204f30bb9e5c70b4e474f2` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:46.969525 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d253320-267a-4bd7-9da8-f186dc78179f None admin] RBAC: Authorizing `identity:get_user(user_id=6dbe397b3f204f30bb9e5c70b4e474f2)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:46.970933 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d253320-267a-4bd7-9da8-f186dc78179f None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:46.973295 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 103/204] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:48:46 2022] GET /identity/v3/users/6dbe397b3f204f30bb9e5c70b4e474f2 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:46.980499 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d253320-267a-4bd7-9da8-f186dc78179f None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:46.980934 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a5bc7-e5dd-4cfd-aeda-3822b816bf1a None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:47.033421 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa062c3c-804d-4fd6-977d-389f7dbeebd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:47.035076 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa062c3c-804d-4fd6-977d-389f7dbeebd0 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:47.035553 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa062c3c-804d-4fd6-977d-389f7dbeebd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:47.036112 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa062c3c-804d-4fd6-977d-389f7dbeebd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:47.037065 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa062c3c-804d-4fd6-977d-389f7dbeebd0 None admin] RBAC: Adding query filter params (role.id=d1f3d1431da145709a5e9b374f3b403d, scope.project.id=266db3a9097e4be4adb44df90ab84a02, user.id=6dbe397b3f204f30bb9e5c70b4e474f2) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:47.037587 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa062c3c-804d-4fd6-977d-389f7dbeebd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:47.039271 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa062c3c-804d-4fd6-977d-389f7dbeebd0 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:47.047557 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 102/205] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 11:48:46 2022] GET /identity/v3/role_assignments?user.id=6dbe397b3f204f30bb9e5c70b4e474f2&scope.project.id=266db3a9097e4be4adb44df90ab84a02&role.id=d1f3d1431da145709a5e9b374f3b403d => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:47.094384 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:47.123392 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d253320-267a-4bd7-9da8-f186dc78179f None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:47.165617 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637e983-4913-489f-81fa-fd59371aee24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:47.166313 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637e983-4913-489f-81fa-fd59371aee24 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:47.166855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637e983-4913-489f-81fa-fd59371aee24 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:47.167125 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637e983-4913-489f-81fa-fd59371aee24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:47.253016 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637e983-4913-489f-81fa-fd59371aee24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:47.254889 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637e983-4913-489f-81fa-fd59371aee24 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:47.338677 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:47.363558 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 104/206] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:48:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:48:47.369155 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa062c3c-804d-4fd6-977d-389f7dbeebd0 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:47.474776 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa062c3c-804d-4fd6-977d-389f7dbeebd0 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:47.495737 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:47.514788 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb8cf4-9735-4422-a1d2-a6b39e9446cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:47.515418 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb8cf4-9735-4422-a1d2-a6b39e9446cd None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:47.515693 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb8cf4-9735-4422-a1d2-a6b39e9446cd None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:47.515958 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb8cf4-9735-4422-a1d2-a6b39e9446cd None admin] PATH_INFO: `/v3/projects/266db3a9097e4be4adb44df90ab84a02` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:47.517117 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb8cf4-9735-4422-a1d2-a6b39e9446cd None admin] RBAC: Authorizing `identity:get_project(project_id=266db3a9097e4be4adb44df90ab84a02)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:47.518549 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb8cf4-9735-4422-a1d2-a6b39e9446cd None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:47.520377 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 103/207] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:48:47 2022] GET /identity/v3/projects/266db3a9097e4be4adb44df90ab84a02 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:47.526194 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637e983-4913-489f-81fa-fd59371aee24 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:47.631750 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637e983-4913-489f-81fa-fd59371aee24 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:47.669506 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44570727-b4f1-444a-88ec-04b34fbef353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:47.670110 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44570727-b4f1-444a-88ec-04b34fbef353 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:47.670389 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44570727-b4f1-444a-88ec-04b34fbef353 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:47.670654 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44570727-b4f1-444a-88ec-04b34fbef353 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:47.671382 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44570727-b4f1-444a-88ec-04b34fbef353 None admin] RBAC: Adding query filter params (role.id=c163d39b46d24a27a76fb9026fec24ff, scope.project.id=266db3a9097e4be4adb44df90ab84a02, user.id=6dbe397b3f204f30bb9e5c70b4e474f2) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:47.671686 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44570727-b4f1-444a-88ec-04b34fbef353 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:47.673188 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44570727-b4f1-444a-88ec-04b34fbef353 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:47.679521 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 105/208] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 11:48:47 2022] GET /identity/v3/role_assignments?user.id=6dbe397b3f204f30bb9e5c70b4e474f2&scope.project.id=266db3a9097e4be4adb44df90ab84a02&role.id=c163d39b46d24a27a76fb9026fec24ff => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:49.364694 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc605095-6968-4f92-81e3-c36efb33e002 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:49.365245 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc605095-6968-4f92-81e3-c36efb33e002 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:49.365245 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc605095-6968-4f92-81e3-c36efb33e002 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:49.366744 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 104/209] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:49.372522 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f24c1-4762-43b1-96a5-2820f493cbf4 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:49.372918 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f24c1-4762-43b1-96a5-2820f493cbf4 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:49.373112 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f24c1-4762-43b1-96a5-2820f493cbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:49.392279 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-b54f24c1-4762-43b1-96a5-2820f493cbf4 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:49.393460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-b54f24c1-4762-43b1-96a5-2820f493cbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:49.429270 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:49.465636 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 106/210] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:48:49.486156 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb4dbe-a228-4beb-8299-e322fd5a7dac None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:49.486483 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb4dbe-a228-4beb-8299-e322fd5a7dac None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:49.486728 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb4dbe-a228-4beb-8299-e322fd5a7dac None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:49.488431 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 105/211] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:49.493963 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efb280-b77d-49b8-bf6e-85ad1c074463 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:49.494252 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efb280-b77d-49b8-bf6e-85ad1c074463 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:49.494526 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efb280-b77d-49b8-bf6e-85ad1c074463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:49.514329 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-58efb280-b77d-49b8-bf6e-85ad1c074463 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:49.515511 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-58efb280-b77d-49b8-bf6e-85ad1c074463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:49.574610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcff70-24a7-45af-9607-731715a6cee1 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:49.574950 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcff70-24a7-45af-9607-731715a6cee1 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:49.575160 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcff70-24a7-45af-9607-731715a6cee1 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:49.584178 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 106/212] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:49.586805 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 107/213] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:48:49.590385 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1eab48-5720-4bcc-b4b2-853a170f9ce2 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:49.590670 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1eab48-5720-4bcc-b4b2-853a170f9ce2 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:49.590943 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1eab48-5720-4bcc-b4b2-853a170f9ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:49.611592 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-4c1eab48-5720-4bcc-b4b2-853a170f9ce2 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:49.612977 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-4c1eab48-5720-4bcc-b4b2-853a170f9ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:49.682007 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 107/214] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:48:49.825164 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efb280-b77d-49b8-bf6e-85ad1c074463 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:49.909042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1eab48-5720-4bcc-b4b2-853a170f9ce2 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:49.940666 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:49.944986 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efb280-b77d-49b8-bf6e-85ad1c074463 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:49.982092 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38562c17-4687-4f2e-8e39-04a07493e9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:49.983078 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38562c17-4687-4f2e-8e39-04a07493e9d6 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:49.983655 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38562c17-4687-4f2e-8e39-04a07493e9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:49.984143 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38562c17-4687-4f2e-8e39-04a07493e9d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:49.995282 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38562c17-4687-4f2e-8e39-04a07493e9d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:48:50.001883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-38562c17-4687-4f2e-8e39-04a07493e9d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:48:50.001883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:48:50.001883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:48:50.001883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:48:50.001883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:48:50.001883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:48:50.001883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:48:50.001883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:48:50.001883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:48:50.001883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:48:50.001883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:48:50.001883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:48:50.001883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:48:50.001883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:48:50.001883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:48:50.001883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:48:50.002824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:48:50.002824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:48:50.002824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:48:50.002824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:48:50.002824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:48:50.002824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:48:50.002824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:48:50.002824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:48:50.002824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:48:50.002824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:48:50.002824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:48:50.002824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:48:50.002824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:48:50.002824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:48:50.002824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:48:50.002824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:48:50.003603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:48:50.003603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:48:50.003603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:48:50.003603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:48:50.003603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:48:50.003603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:48:50.003603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:48:50.003603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:48:50.003603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:48:50.003603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:48:50.003603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:48:50.003603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:48:50.006372 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 108/215] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:48:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:48:50.007356 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38562c17-4687-4f2e-8e39-04a07493e9d6 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:50.030673 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1eab48-5720-4bcc-b4b2-853a170f9ce2 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:50.045693 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:50.065922 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371a904-8de4-4483-a56c-e622f2535acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:50.066552 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371a904-8de4-4483-a56c-e622f2535acf None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:50.066829 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371a904-8de4-4483-a56c-e622f2535acf None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:50.067096 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371a904-8de4-4483-a56c-e622f2535acf None admin] PATH_INFO: `/v3/domains/default` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:50.068236 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371a904-8de4-4483-a56c-e622f2535acf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:50.069677 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371a904-8de4-4483-a56c-e622f2535acf None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:50.071248 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 108/216] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:48:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:48:50.072032 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371a904-8de4-4483-a56c-e622f2535acf None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:50.122512 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38562c17-4687-4f2e-8e39-04a07493e9d6 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:50.158967 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94145a91-1461-46e5-8cb9-a5a43eccd4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:50.159589 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94145a91-1461-46e5-8cb9-a5a43eccd4f8 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:50.159858 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94145a91-1461-46e5-8cb9-a5a43eccd4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:50.160152 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94145a91-1461-46e5-8cb9-a5a43eccd4f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:50.171163 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94145a91-1461-46e5-8cb9-a5a43eccd4f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:48:50.174893 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371a904-8de4-4483-a56c-e622f2535acf None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:50.176043 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-94145a91-1461-46e5-8cb9-a5a43eccd4f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:48:50.176043 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:48:50.176043 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:48:50.176043 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:48:50.176043 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:48:50.176043 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:48:50.176043 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:48:50.176043 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:48:50.176043 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:48:50.176043 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:48:50.176043 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:48:50.176043 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:48:50.176043 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:48:50.176043 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:48:50.176043 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:48:50.176043 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:48:50.177033 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:48:50.177033 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:48:50.177033 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:48:50.177033 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:48:50.177033 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:48:50.177033 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:48:50.177033 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:48:50.177033 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:48:50.177033 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:48:50.177033 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:48:50.177033 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:48:50.177033 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:48:50.177033 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:48:50.177033 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:48:50.177033 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:48:50.177033 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:48:50.177921 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:48:50.177921 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:48:50.177921 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:48:50.177921 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:48:50.177921 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:48:50.177921 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:48:50.177921 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:48:50.177921 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:48:50.177921 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:48:50.177921 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:48:50.177921 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:48:50.177921 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:48:50.177921 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 109/217] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 11:48:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:48:50.178610 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94145a91-1461-46e5-8cb9-a5a43eccd4f8 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:50.199397 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:50.211238 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfafb0-cb41-48eb-ac11-8ab5b91a3885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:50.211836 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfafb0-cb41-48eb-ac11-8ab5b91a3885 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:50.212144 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfafb0-cb41-48eb-ac11-8ab5b91a3885 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:50.212409 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfafb0-cb41-48eb-ac11-8ab5b91a3885 None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:50.213063 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccfafb0-cb41-48eb-ac11-8ab5b91a3885 None admin] RBAC: Adding query filter params (name=member) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:50.213362 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccfafb0-cb41-48eb-ac11-8ab5b91a3885 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:50.215246 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccfafb0-cb41-48eb-ac11-8ab5b91a3885 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:50.223014 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 109/218] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 11:48:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:50.224169 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0b923-da39-459e-9dd9-f0b9c311a25f None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:50.224443 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0b923-da39-459e-9dd9-f0b9c311a25f None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:50.224709 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0b923-da39-459e-9dd9-f0b9c311a25f None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:50.225882 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 110/219] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:50.226557 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0b923-da39-459e-9dd9-f0b9c311a25f None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:50.275978 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:50.283840 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94145a91-1461-46e5-8cb9-a5a43eccd4f8 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:50.318572 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba2557-ea75-421e-b1d3-6346106149ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:50.319168 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba2557-ea75-421e-b1d3-6346106149ee None admin] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:50.319440 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba2557-ea75-421e-b1d3-6346106149ee None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:50.319706 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba2557-ea75-421e-b1d3-6346106149ee None admin] PATH_INFO: `/v3/users` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:50.320370 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba2557-ea75-421e-b1d3-6346106149ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:50.321809 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba2557-ea75-421e-b1d3-6346106149ee None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:50.331806 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0b923-da39-459e-9dd9-f0b9c311a25f None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:50.344630 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 110/220] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 21 11:48:50 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 11:48:50.345759 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba2557-ea75-421e-b1d3-6346106149ee None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:50.373622 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9bb84f-46f7-45a1-a2e9-513ddfc319a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:50.374252 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9bb84f-46f7-45a1-a2e9-513ddfc319a7 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:50.374529 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9bb84f-46f7-45a1-a2e9-513ddfc319a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:50.374802 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9bb84f-46f7-45a1-a2e9-513ddfc319a7 None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:50.375494 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9bb84f-46f7-45a1-a2e9-513ddfc319a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:50.375786 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9bb84f-46f7-45a1-a2e9-513ddfc319a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:50.377250 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9bb84f-46f7-45a1-a2e9-513ddfc319a7 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:50.387459 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 111/221] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:48:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:50.388772 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c65ac-4f5a-464d-bacf-85ec87aa2656 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:50.389057 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c65ac-4f5a-464d-bacf-85ec87aa2656 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:50.389327 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c65ac-4f5a-464d-bacf-85ec87aa2656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:50.409648 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-6f5c65ac-4f5a-464d-bacf-85ec87aa2656 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:50.410902 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-6f5c65ac-4f5a-464d-bacf-85ec87aa2656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:50.450602 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:50.482930 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba2557-ea75-421e-b1d3-6346106149ee None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:50.493944 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 112/222] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:48:50.493944 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c65ac-4f5a-464d-bacf-85ec87aa2656 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:50.536484 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269c5de-a31b-4388-8d74-9b7761efff9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:50.537137 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269c5de-a31b-4388-8d74-9b7761efff9a None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:50.537422 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269c5de-a31b-4388-8d74-9b7761efff9a None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:50.537672 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269c5de-a31b-4388-8d74-9b7761efff9a None admin] PATH_INFO: `/v3/users/4c02a9254944451fb4ddb3019bbd5b5a` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:50.545244 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:50.560422 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a269c5de-a31b-4388-8d74-9b7761efff9a None admin] RBAC: Authorizing `identity:get_user(user_id=4c02a9254944451fb4ddb3019bbd5b5a)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:50.562423 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a269c5de-a31b-4388-8d74-9b7761efff9a None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:50.564793 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 111/223] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:48:50 2022] GET /identity/v3/users/4c02a9254944451fb4ddb3019bbd5b5a => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:50.570802 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269c5de-a31b-4388-8d74-9b7761efff9a None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:50.631789 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c65ac-4f5a-464d-bacf-85ec87aa2656 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:50.685484 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbaef73-2c5a-4619-b44f-c4d0b3f929b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:50.686126 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbaef73-2c5a-4619-b44f-c4d0b3f929b5 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:50.686407 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbaef73-2c5a-4619-b44f-c4d0b3f929b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:50.686670 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbaef73-2c5a-4619-b44f-c4d0b3f929b5 None admin] PATH_INFO: `/v3/users/6dbe397b3f204f30bb9e5c70b4e474f2` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:50.688528 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbaef73-2c5a-4619-b44f-c4d0b3f929b5 None admin] RBAC: Authorizing `identity:get_user(user_id=6dbe397b3f204f30bb9e5c70b4e474f2)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:50.690367 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbaef73-2c5a-4619-b44f-c4d0b3f929b5 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:50.692046 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 113/224] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:48:50 2022] GET /identity/v3/users/6dbe397b3f204f30bb9e5c70b4e474f2 => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:50.698312 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbaef73-2c5a-4619-b44f-c4d0b3f929b5 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:50.708946 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269c5de-a31b-4388-8d74-9b7761efff9a None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:50.749477 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170eebe-e482-4c77-ae92-9cbcee152d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:50.750326 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170eebe-e482-4c77-ae92-9cbcee152d72 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:50.750794 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170eebe-e482-4c77-ae92-9cbcee152d72 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:50.751263 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170eebe-e482-4c77-ae92-9cbcee152d72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:50.755294 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:50.816143 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbaef73-2c5a-4619-b44f-c4d0b3f929b5 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:50.818621 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:50.847551 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170eebe-e482-4c77-ae92-9cbcee152d72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:50.849464 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170eebe-e482-4c77-ae92-9cbcee152d72 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:50.856310 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf741b-dee6-4ffd-9de3-ba52f6a92f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:50.857067 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf741b-dee6-4ffd-9de3-ba52f6a92f15 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:50.857467 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf741b-dee6-4ffd-9de3-ba52f6a92f15 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:50.857924 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf741b-dee6-4ffd-9de3-ba52f6a92f15 None admin] PATH_INFO: `/v3/projects/266db3a9097e4be4adb44df90ab84a02` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:50.859315 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf741b-dee6-4ffd-9de3-ba52f6a92f15 None admin] RBAC: Authorizing `identity:get_project(project_id=266db3a9097e4be4adb44df90ab84a02)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:50.860788 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf741b-dee6-4ffd-9de3-ba52f6a92f15 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:50.862570 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 114/225] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:48:50 2022] GET /identity/v3/projects/266db3a9097e4be4adb44df90ab84a02 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:48:50.868027 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf741b-dee6-4ffd-9de3-ba52f6a92f15 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:50.961679 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 112/226] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:48:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 21 11:48:50.962282 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170eebe-e482-4c77-ae92-9cbcee152d72 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:50.982125 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf741b-dee6-4ffd-9de3-ba52f6a92f15 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:51.002220 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:51.022561 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbe112-74f9-4a8d-9b0d-40d386550896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:51.023534 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbe112-74f9-4a8d-9b0d-40d386550896 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:51.024158 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbe112-74f9-4a8d-9b0d-40d386550896 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:51.024672 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbe112-74f9-4a8d-9b0d-40d386550896 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:51.038158 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cbe112-74f9-4a8d-9b0d-40d386550896 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:48:51.045549 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-84cbe112-74f9-4a8d-9b0d-40d386550896 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 11:48:51.045549 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:48:51.045549 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:48:51.045549 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:48:51.045549 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:48:51.045549 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:48:51.045549 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:48:51.045549 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:48:51.045549 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:48:51.045549 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:48:51.045549 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:48:51.045549 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:48:51.045549 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:48:51.045549 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:48:51.045549 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:48:51.045549 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:48:51.046472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:48:51.046472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:48:51.046472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:48:51.046472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:48:51.046472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:48:51.046472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:48:51.046472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:48:51.046472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:48:51.046472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:48:51.046472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:48:51.046472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:48:51.046472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:48:51.046472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:48:51.046472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:48:51.046472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:48:51.046472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:48:51.047266 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:48:51.047266 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:48:51.047266 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:48:51.047266 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:48:51.047266 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:48:51.047266 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:48:51.047266 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:48:51.047266 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:48:51.047266 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:48:51.047266 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:48:51.047266 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 11:48:51.047266 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:48:51.050133 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 115/227] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 11:48:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:48:51.055343 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbe112-74f9-4a8d-9b0d-40d386550896 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:51.080251 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170eebe-e482-4c77-ae92-9cbcee152d72 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:51.101693 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:51.121853 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4deca3-de0d-44b8-97b3-99eca77e0bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:51.122563 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4deca3-de0d-44b8-97b3-99eca77e0bd5 None admin] REQUEST_METHOD: `PUT` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:51.122846 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4deca3-de0d-44b8-97b3-99eca77e0bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:51.123121 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4deca3-de0d-44b8-97b3-99eca77e0bd5 None admin] PATH_INFO: `/v3/projects/266db3a9097e4be4adb44df90ab84a02/users/6dbe397b3f204f30bb9e5c70b4e474f2/roles/d1f3d1431da145709a5e9b374f3b403d` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:51.125308 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4deca3-de0d-44b8-97b3-99eca77e0bd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=266db3a9097e4be4adb44df90ab84a02, user_id=6dbe397b3f204f30bb9e5c70b4e474f2, role_id=d1f3d1431da145709a5e9b374f3b403d)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:51.126904 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4deca3-de0d-44b8-97b3-99eca77e0bd5 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:51.144934 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 113/228] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 11:48:50 2022] PUT /identity/v3/projects/266db3a9097e4be4adb44df90ab84a02/users/6dbe397b3f204f30bb9e5c70b4e474f2/roles/d1f3d1431da145709a5e9b374f3b403d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 11:48:51.145745 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4deca3-de0d-44b8-97b3-99eca77e0bd5 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:51.193804 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbe112-74f9-4a8d-9b0d-40d386550896 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:51.255819 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:51.257249 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2fc6d8-45f8-43fd-8840-1692716c9a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:51.258149 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fc6d8-45f8-43fd-8840-1692716c9a4b None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:51.258717 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fc6d8-45f8-43fd-8840-1692716c9a4b None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:51.259188 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fc6d8-45f8-43fd-8840-1692716c9a4b None admin] PATH_INFO: `/v3/projects/266db3a9097e4be4adb44df90ab84a02` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:51.263900 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4deca3-de0d-44b8-97b3-99eca77e0bd5 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:51.265081 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2fc6d8-45f8-43fd-8840-1692716c9a4b None admin] RBAC: Authorizing `identity:get_project(project_id=266db3a9097e4be4adb44df90ab84a02)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:51.267893 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2fc6d8-45f8-43fd-8840-1692716c9a4b None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:51.270022 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 116/229] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:48:51 2022] GET /identity/v3/projects/266db3a9097e4be4adb44df90ab84a02 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:51.277024 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2fc6d8-45f8-43fd-8840-1692716c9a4b None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:51.305716 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10166dd-6b86-4ffd-a40c-e39fa2e5b866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:51.308026 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10166dd-6b86-4ffd-a40c-e39fa2e5b866 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:51.308026 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10166dd-6b86-4ffd-a40c-e39fa2e5b866 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:51.308026 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10166dd-6b86-4ffd-a40c-e39fa2e5b866 None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:51.308026 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10166dd-6b86-4ffd-a40c-e39fa2e5b866 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:51.308026 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10166dd-6b86-4ffd-a40c-e39fa2e5b866 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:51.309479 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10166dd-6b86-4ffd-a40c-e39fa2e5b866 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:51.319284 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 114/230] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:48:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:51.328701 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10166dd-6b86-4ffd-a40c-e39fa2e5b866 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:51.435110 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:51.439983 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2fc6d8-45f8-43fd-8840-1692716c9a4b None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:51.474451 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10166dd-6b86-4ffd-a40c-e39fa2e5b866 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:51.483252 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffd57a-0e39-4297-9982-a8943c09fde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:51.484579 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffd57a-0e39-4297-9982-a8943c09fde3 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:51.484996 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffd57a-0e39-4297-9982-a8943c09fde3 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:51.485398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffd57a-0e39-4297-9982-a8943c09fde3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:51.486700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ffd57a-0e39-4297-9982-a8943c09fde3 None admin] RBAC: Adding query filter params (role.id=165db5ccce0540569e708b81df7a5577, scope.project.id=266db3a9097e4be4adb44df90ab84a02, user.id=4c02a9254944451fb4ddb3019bbd5b5a) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:51.487147 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ffd57a-0e39-4297-9982-a8943c09fde3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:51.489387 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ffd57a-0e39-4297-9982-a8943c09fde3 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:51.497676 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 117/231] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 11:48:51 2022] GET /identity/v3/role_assignments?user.id=4c02a9254944451fb4ddb3019bbd5b5a&scope.project.id=266db3a9097e4be4adb44df90ab84a02&role.id=165db5ccce0540569e708b81df7a5577 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:51.522244 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31c641-9222-4599-a16c-0778237697d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:51.522975 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31c641-9222-4599-a16c-0778237697d2 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:51.523353 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31c641-9222-4599-a16c-0778237697d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:51.523734 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31c641-9222-4599-a16c-0778237697d2 None admin] PATH_INFO: `/v3/users/6dbe397b3f204f30bb9e5c70b4e474f2` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:51.525241 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31c641-9222-4599-a16c-0778237697d2 None admin] RBAC: Authorizing `identity:get_user(user_id=6dbe397b3f204f30bb9e5c70b4e474f2)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:51.526854 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31c641-9222-4599-a16c-0778237697d2 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:51.528955 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 115/232] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:48:51 2022] GET /identity/v3/users/6dbe397b3f204f30bb9e5c70b4e474f2 => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:51.534821 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffd57a-0e39-4297-9982-a8943c09fde3 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:51.669265 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffd57a-0e39-4297-9982-a8943c09fde3 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:51.711636 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4370f-97e7-43d8-8b94-691f7962bb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:51.712556 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4370f-97e7-43d8-8b94-691f7962bb06 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:51.712971 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4370f-97e7-43d8-8b94-691f7962bb06 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:51.713403 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4370f-97e7-43d8-8b94-691f7962bb06 None admin] PATH_INFO: `/v3/projects/266db3a9097e4be4adb44df90ab84a02` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:51.714707 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4370f-97e7-43d8-8b94-691f7962bb06 None admin] RBAC: Authorizing `identity:get_project(project_id=266db3a9097e4be4adb44df90ab84a02)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:51.716295 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4370f-97e7-43d8-8b94-691f7962bb06 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:51.718759 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 118/233] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:48:51 2022] GET /identity/v3/projects/266db3a9097e4be4adb44df90ab84a02 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:51.728026 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31c641-9222-4599-a16c-0778237697d2 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:51.779012 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:51.896650 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31c641-9222-4599-a16c-0778237697d2 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:51.945375 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cb04c-d46a-4986-bde9-9b002cb7f4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:51.946040 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cb04c-d46a-4986-bde9-9b002cb7f4db None admin] REQUEST_METHOD: `PUT` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:51.946318 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cb04c-d46a-4986-bde9-9b002cb7f4db None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:51.946592 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cb04c-d46a-4986-bde9-9b002cb7f4db None admin] PATH_INFO: `/v3/projects/266db3a9097e4be4adb44df90ab84a02/users/6dbe397b3f204f30bb9e5c70b4e474f2/roles/c163d39b46d24a27a76fb9026fec24ff` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:51.948856 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cb04c-d46a-4986-bde9-9b002cb7f4db None admin] RBAC: Authorizing `identity:create_grant(project_id=266db3a9097e4be4adb44df90ab84a02, user_id=6dbe397b3f204f30bb9e5c70b4e474f2, role_id=c163d39b46d24a27a76fb9026fec24ff)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:51.950323 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cb04c-d46a-4986-bde9-9b002cb7f4db None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:51.971978 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 116/234] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 11:48:51 2022] PUT /identity/v3/projects/266db3a9097e4be4adb44df90ab84a02/users/6dbe397b3f204f30bb9e5c70b4e474f2/roles/c163d39b46d24a27a76fb9026fec24ff => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 11:48:53.396095 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54530f9-e14b-4c3f-9474-7ab2d8434f45 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:53.396634 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54530f9-e14b-4c3f-9474-7ab2d8434f45 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:53.396634 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54530f9-e14b-4c3f-9474-7ab2d8434f45 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:53.398220 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 119/235] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:53.403889 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26387030-3b32-4f35-9739-69a4f3fefbba None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:53.404374 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26387030-3b32-4f35-9739-69a4f3fefbba None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:53.404490 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26387030-3b32-4f35-9739-69a4f3fefbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:53.429340 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-26387030-3b32-4f35-9739-69a4f3fefbba None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:53.430522 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-26387030-3b32-4f35-9739-69a4f3fefbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:53.518890 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 117/236] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:48:53.885636 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39501f-5f69-4c7f-9d15-433fb0f846f7 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:53.886024 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39501f-5f69-4c7f-9d15-433fb0f846f7 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:53.886199 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39501f-5f69-4c7f-9d15-433fb0f846f7 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:53.887828 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 120/237] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:53.892779 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce88e00-03e5-4318-8674-6828ec49f04e None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:53.893055 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce88e00-03e5-4318-8674-6828ec49f04e None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:53.893324 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce88e00-03e5-4318-8674-6828ec49f04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:53.917272 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-bce88e00-03e5-4318-8674-6828ec49f04e None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:53.919318 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-bce88e00-03e5-4318-8674-6828ec49f04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:53.932109 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:53.996856 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39501f-5f69-4c7f-9d15-433fb0f846f7 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:54.024118 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 118/238] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:48:54.059027 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:54.141395 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb10117-5060-4b25-aec5-147a71e7b184 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:54.141687 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb10117-5060-4b25-aec5-147a71e7b184 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:54.141849 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb10117-5060-4b25-aec5-147a71e7b184 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:54.143440 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 119/239] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 11:48:54.148187 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7358c-c3d2-4efd-b194-67655243dedb None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:54.148469 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7358c-c3d2-4efd-b194-67655243dedb None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:54.148740 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7358c-c3d2-4efd-b194-67655243dedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:54.167494 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-48c7358c-c3d2-4efd-b194-67655243dedb None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:54.168708 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-48c7358c-c3d2-4efd-b194-67655243dedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:54.186131 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39501f-5f69-4c7f-9d15-433fb0f846f7 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:54.248124 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ea374-9c58-40fa-979b-6f5ea3ccb0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:54.248756 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ea374-9c58-40fa-979b-6f5ea3ccb0ab None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:54.249026 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ea374-9c58-40fa-979b-6f5ea3ccb0ab None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:54.249289 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ea374-9c58-40fa-979b-6f5ea3ccb0ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:54.251639 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ea374-9c58-40fa-979b-6f5ea3ccb0ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:54.253454 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ea374-9c58-40fa-979b-6f5ea3ccb0ab None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:54.256815 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 121/240] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:48:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:54.263029 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ea374-9c58-40fa-979b-6f5ea3ccb0ab None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:54.297833 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 120/241] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 11:48:54.412518 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:54.416744 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ea374-9c58-40fa-979b-6f5ea3ccb0ab None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:54.461688 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a6080-c870-4e2c-962d-7d381bbed4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:54.462661 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a6080-c870-4e2c-962d-7d381bbed4a2 None admin] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:54.463130 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a6080-c870-4e2c-962d-7d381bbed4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:54.463613 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a6080-c870-4e2c-962d-7d381bbed4a2 None admin] PATH_INFO: `/v3/users` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:54.465133 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9a6080-c870-4e2c-962d-7d381bbed4a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:54.466757 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9a6080-c870-4e2c-962d-7d381bbed4a2 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:54.474838 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7358c-c3d2-4efd-b194-67655243dedb None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:54.503894 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 122/242] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 21 11:48:54 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 11:48:54.606476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:54.638815 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7358c-c3d2-4efd-b194-67655243dedb None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:54.657448 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e092f8-03e0-4a58-92af-e1cada44da70 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:54.657805 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e092f8-03e0-4a58-92af-e1cada44da70 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:54.657983 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e092f8-03e0-4a58-92af-e1cada44da70 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:54.659508 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 123/243] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 11:48:54.664709 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dbc8e-176f-4d9d-b173-20d4298c35c8 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:54.664938 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dbc8e-176f-4d9d-b173-20d4298c35c8 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:54.665177 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dbc8e-176f-4d9d-b173-20d4298c35c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:54.692181 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-7d8dbc8e-176f-4d9d-b173-20d4298c35c8 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:54.693771 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-7d8dbc8e-176f-4d9d-b173-20d4298c35c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:54.712383 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52e0ac-8d86-4388-90de-a6002b7dbb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:54.713020 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52e0ac-8d86-4388-90de-a6002b7dbb2b None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:54.713294 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52e0ac-8d86-4388-90de-a6002b7dbb2b None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:54.713561 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52e0ac-8d86-4388-90de-a6002b7dbb2b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:54.726010 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a52e0ac-8d86-4388-90de-a6002b7dbb2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:48:54.731202 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-3a52e0ac-8d86-4388-90de-a6002b7dbb2b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 11:48:54.731202 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:48:54.731202 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:48:54.731202 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:48:54.731202 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:48:54.731202 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:48:54.731202 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:48:54.731202 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:48:54.731202 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:48:54.731202 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:48:54.731202 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:48:54.731202 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:48:54.731202 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:48:54.731202 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:48:54.731202 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:48:54.731202 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:48:54.732404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:48:54.732404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:48:54.732404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:48:54.732404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:48:54.732404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:48:54.732404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:48:54.732404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:48:54.732404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:48:54.732404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:48:54.732404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:48:54.732404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:48:54.732404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:48:54.732404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:48:54.732404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:48:54.732404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:48:54.732404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:48:54.733355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:48:54.733355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:48:54.733355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:48:54.733355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:48:54.733355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:48:54.733355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:48:54.733355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:48:54.733355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:48:54.733355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:48:54.733355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:48:54.733355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 11:48:54.733355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:48:54.733355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 121/244] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:48:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:48:54.734125 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52e0ac-8d86-4388-90de-a6002b7dbb2b None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:54.787550 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 124/245] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 11:48:54.792305 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8dbc8e-176f-4d9d-b173-20d4298c35c8 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:54.865424 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52e0ac-8d86-4388-90de-a6002b7dbb2b None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:54.903414 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:54.903818 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a5fd0-0e59-47ab-bfc1-c6a011138ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:54.904841 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a5fd0-0e59-47ab-bfc1-c6a011138ee5 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:54.905139 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a5fd0-0e59-47ab-bfc1-c6a011138ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:54.905723 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a5fd0-0e59-47ab-bfc1-c6a011138ee5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:54.908182 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:54.920727 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a5fd0-0e59-47ab-bfc1-c6a011138ee5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:48:54.925505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-937a5fd0-0e59-47ab-bfc1-c6a011138ee5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:48:54.925505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:48:54.925505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:48:54.925505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:48:54.925505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:48:54.925505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:48:54.925505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:48:54.925505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:48:54.925505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:48:54.925505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:48:54.925505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:48:54.925505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:48:54.925505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:48:54.925505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:48:54.925505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:48:54.925505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:48:54.926603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:48:54.926603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:48:54.926603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:48:54.926603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:48:54.926603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:48:54.926603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:48:54.926603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:48:54.926603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:48:54.926603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:48:54.926603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:48:54.926603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:48:54.926603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:48:54.926603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:48:54.926603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:48:54.926603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:48:54.926603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:48:54.927609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:48:54.927609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:48:54.927609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:48:54.927609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:48:54.927609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:48:54.927609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:48:54.927609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:48:54.927609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:48:54.927609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:48:54.927609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:48:54.927609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:48:54.927609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:48:54.927609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 122/246] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 11:48:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:48:54.933467 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8dbc8e-176f-4d9d-b173-20d4298c35c8 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:54.934721 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a5fd0-0e59-47ab-bfc1-c6a011138ee5 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:54.976593 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a965c4-14f3-4ebb-8714-104d4f62e415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:54.977561 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a965c4-14f3-4ebb-8714-104d4f62e415 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:54.978036 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a965c4-14f3-4ebb-8714-104d4f62e415 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:54.978498 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a965c4-14f3-4ebb-8714-104d4f62e415 None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:54.979353 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a965c4-14f3-4ebb-8714-104d4f62e415 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:54.979845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a965c4-14f3-4ebb-8714-104d4f62e415 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:54.981470 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a965c4-14f3-4ebb-8714-104d4f62e415 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:54.991329 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 125/247] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 11:48:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:54.998056 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a965c4-14f3-4ebb-8714-104d4f62e415 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:55.070245 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a5fd0-0e59-47ab-bfc1-c6a011138ee5 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:55.107639 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a3e9a-5c3a-406c-9860-19f6b5a19ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:55.108282 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a3e9a-5c3a-406c-9860-19f6b5a19ff1 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:55.108555 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a3e9a-5c3a-406c-9860-19f6b5a19ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:55.108820 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a3e9a-5c3a-406c-9860-19f6b5a19ff1 None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:55.109479 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a3e9a-5c3a-406c-9860-19f6b5a19ff1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:55.109772 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a3e9a-5c3a-406c-9860-19f6b5a19ff1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:55.111343 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a3e9a-5c3a-406c-9860-19f6b5a19ff1 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:55.122093 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 123/248] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:48:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:55.128772 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a965c4-14f3-4ebb-8714-104d4f62e415 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:55.131348 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a3e9a-5c3a-406c-9860-19f6b5a19ff1 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:55.170447 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a94a1-c20c-47b4-9e27-a0aa596bd8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:55.171632 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a94a1-c20c-47b4-9e27-a0aa596bd8f3 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:55.172146 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a94a1-c20c-47b4-9e27-a0aa596bd8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:55.172685 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a94a1-c20c-47b4-9e27-a0aa596bd8f3 None admin] PATH_INFO: `/v3/users/ae30f19084ad47069c943582b81f1201` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:55.189027 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a94a1-c20c-47b4-9e27-a0aa596bd8f3 None admin] RBAC: Authorizing `identity:get_user(user_id=ae30f19084ad47069c943582b81f1201)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:55.190860 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a94a1-c20c-47b4-9e27-a0aa596bd8f3 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:55.192962 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:55.194700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 126/249] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:48:54 2022] GET /identity/v3/users/ae30f19084ad47069c943582b81f1201 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:55.196229 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a94a1-c20c-47b4-9e27-a0aa596bd8f3 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:55.206775 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:55.245304 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a3e9a-5c3a-406c-9860-19f6b5a19ff1 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:55.289072 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e90487-f0cb-44ee-b136-0a328e3dcf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:55.289701 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e90487-f0cb-44ee-b136-0a328e3dcf6d None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:55.289977 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e90487-f0cb-44ee-b136-0a328e3dcf6d None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:55.290248 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e90487-f0cb-44ee-b136-0a328e3dcf6d None admin] PATH_INFO: `/v3/users/6dbe397b3f204f30bb9e5c70b4e474f2` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:55.291404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e90487-f0cb-44ee-b136-0a328e3dcf6d None admin] RBAC: Authorizing `identity:get_user(user_id=6dbe397b3f204f30bb9e5c70b4e474f2)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:55.293771 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e90487-f0cb-44ee-b136-0a328e3dcf6d None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:55.296356 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 124/250] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:48:55 2022] GET /identity/v3/users/6dbe397b3f204f30bb9e5c70b4e474f2 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:55.298348 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843af27b-15d0-4362-abd0-8c57c8c1eb35 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:55.298831 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843af27b-15d0-4362-abd0-8c57c8c1eb35 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:55.299295 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843af27b-15d0-4362-abd0-8c57c8c1eb35 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:55.301601 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 125/251] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:55.302791 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843af27b-15d0-4362-abd0-8c57c8c1eb35 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:55.325901 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a94a1-c20c-47b4-9e27-a0aa596bd8f3 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:55.364217 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16b2c7-7dba-4165-ba30-15001db712d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:55.364840 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16b2c7-7dba-4165-ba30-15001db712d8 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:55.365110 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16b2c7-7dba-4165-ba30-15001db712d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:55.365373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16b2c7-7dba-4165-ba30-15001db712d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:55.378506 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16b2c7-7dba-4165-ba30-15001db712d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:48:55.385173 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-8f16b2c7-7dba-4165-ba30-15001db712d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:48:55.385173 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:48:55.385173 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:48:55.385173 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:48:55.385173 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:48:55.385173 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:48:55.385173 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:48:55.385173 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:48:55.385173 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:48:55.385173 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:48:55.385173 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:48:55.385173 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:48:55.385173 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:48:55.385173 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:48:55.385173 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:48:55.385173 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:48:55.386128 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:48:55.386128 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:48:55.386128 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:48:55.386128 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:48:55.386128 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:48:55.386128 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:48:55.386128 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:48:55.386128 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:48:55.386128 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:48:55.386128 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:48:55.386128 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:48:55.386128 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:48:55.386128 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:48:55.386128 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:48:55.386128 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:48:55.386128 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:48:55.387530 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:48:55.387530 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:48:55.387530 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:48:55.387530 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:48:55.387530 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:48:55.387530 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:48:55.387530 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:48:55.387530 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:48:55.387530 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:48:55.387530 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:48:55.387530 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:48:55.387530 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:48:55.387530 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 127/252] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:48:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:48:55.388239 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16b2c7-7dba-4165-ba30-15001db712d8 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:55.452479 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843af27b-15d0-4362-abd0-8c57c8c1eb35 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:55.480358 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:55.484822 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:55.502228 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123b29a-6758-49a6-9254-d0ea117618cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:55.503709 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123b29a-6758-49a6-9254-d0ea117618cd None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:55.504177 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123b29a-6758-49a6-9254-d0ea117618cd None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:55.504747 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123b29a-6758-49a6-9254-d0ea117618cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:55.508332 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16b2c7-7dba-4165-ba30-15001db712d8 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:55.551695 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f0e47-deca-44b1-85c3-001a4fdf2c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:55.552502 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f0e47-deca-44b1-85c3-001a4fdf2c3b None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:55.553116 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f0e47-deca-44b1-85c3-001a4fdf2c3b None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:55.553481 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f0e47-deca-44b1-85c3-001a4fdf2c3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:55.600255 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123b29a-6758-49a6-9254-d0ea117618cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:55.601976 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123b29a-6758-49a6-9254-d0ea117618cd None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:55.650077 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f0e47-deca-44b1-85c3-001a4fdf2c3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:55.651873 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f0e47-deca-44b1-85c3-001a4fdf2c3b None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:55.718402 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 126/253] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:48:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:48:55.719615 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0bd9c-af9c-4b59-930e-6bfd87c4a086 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:55.719906 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0bd9c-af9c-4b59-930e-6bfd87c4a086 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:55.720216 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0bd9c-af9c-4b59-930e-6bfd87c4a086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:55.729625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:55.742080 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-79f0bd9c-af9c-4b59-930e-6bfd87c4a086 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:55.743644 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-79f0bd9c-af9c-4b59-930e-6bfd87c4a086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:55.763957 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:55.772074 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 128/254] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:48:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:48:55.773385 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f0e47-deca-44b1-85c3-001a4fdf2c3b None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:55.824962 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 127/255] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:48:55.826320 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0bd9c-af9c-4b59-930e-6bfd87c4a086 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:55.897423 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f0e47-deca-44b1-85c3-001a4fdf2c3b None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:55.945459 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0bd9c-af9c-4b59-930e-6bfd87c4a086 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:55.949940 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd946c-9efe-42fd-ac36-d25c9dca0621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:55.950558 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd946c-9efe-42fd-ac36-d25c9dca0621 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:55.950839 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd946c-9efe-42fd-ac36-d25c9dca0621 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:55.951110 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd946c-9efe-42fd-ac36-d25c9dca0621 None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:55.951779 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd946c-9efe-42fd-ac36-d25c9dca0621 None admin] RBAC: Adding query filter params (name=member) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:55.952108 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd946c-9efe-42fd-ac36-d25c9dca0621 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:55.953478 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd946c-9efe-42fd-ac36-d25c9dca0621 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:55.973820 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 129/256] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 11:48:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:55.975717 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd946c-9efe-42fd-ac36-d25c9dca0621 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:56.019888 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb3ec5-b72a-4228-b488-0d190d6286f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:56.020988 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb3ec5-b72a-4228-b488-0d190d6286f4 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:56.022471 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb3ec5-b72a-4228-b488-0d190d6286f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:56.023016 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb3ec5-b72a-4228-b488-0d190d6286f4 None admin] PATH_INFO: `/v3/projects/266db3a9097e4be4adb44df90ab84a02` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:56.027953 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb3ec5-b72a-4228-b488-0d190d6286f4 None admin] RBAC: Authorizing `identity:get_project(project_id=266db3a9097e4be4adb44df90ab84a02)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:56.030315 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb3ec5-b72a-4228-b488-0d190d6286f4 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:56.035156 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 128/257] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:48:55 2022] GET /identity/v3/projects/266db3a9097e4be4adb44df90ab84a02 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:56.036434 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb3ec5-b72a-4228-b488-0d190d6286f4 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:56.044490 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:56.090268 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:56.162317 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd946c-9efe-42fd-ac36-d25c9dca0621 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:56.208998 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e75691-e90b-45a2-b0e8-991e91008672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:56.209992 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e75691-e90b-45a2-b0e8-991e91008672 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:56.210672 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e75691-e90b-45a2-b0e8-991e91008672 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:56.212149 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e75691-e90b-45a2-b0e8-991e91008672 None admin] PATH_INFO: `/v3/projects/266db3a9097e4be4adb44df90ab84a02` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:56.213667 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e75691-e90b-45a2-b0e8-991e91008672 None admin] RBAC: Authorizing `identity:get_project(project_id=266db3a9097e4be4adb44df90ab84a02)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:56.217662 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e75691-e90b-45a2-b0e8-991e91008672 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:56.219901 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 130/258] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:48:55 2022] GET /identity/v3/projects/266db3a9097e4be4adb44df90ab84a02 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:56.221149 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e75691-e90b-45a2-b0e8-991e91008672 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:56.239616 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb3ec5-b72a-4228-b488-0d190d6286f4 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:56.290446 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7140ccd-d286-4e18-b36a-a37c8cf49908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:56.292026 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7140ccd-d286-4e18-b36a-a37c8cf49908 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:56.292310 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7140ccd-d286-4e18-b36a-a37c8cf49908 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:56.294934 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7140ccd-d286-4e18-b36a-a37c8cf49908 None admin] PATH_INFO: `/v3/users/4c02a9254944451fb4ddb3019bbd5b5a` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:56.296556 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7140ccd-d286-4e18-b36a-a37c8cf49908 None admin] RBAC: Authorizing `identity:get_user(user_id=4c02a9254944451fb4ddb3019bbd5b5a)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:56.298309 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7140ccd-d286-4e18-b36a-a37c8cf49908 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:56.300511 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 129/259] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:48:56 2022] GET /identity/v3/users/4c02a9254944451fb4ddb3019bbd5b5a => generated 297 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:56.301630 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7140ccd-d286-4e18-b36a-a37c8cf49908 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:56.375579 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:56.384990 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e75691-e90b-45a2-b0e8-991e91008672 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:56.414224 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:56.430413 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7140ccd-d286-4e18-b36a-a37c8cf49908 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:56.433789 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8867ee9-dee4-4feb-be93-3b317006d034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:56.434091 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8867ee9-dee4-4feb-be93-3b317006d034 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:56.434372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8867ee9-dee4-4feb-be93-3b317006d034 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:56.434640 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8867ee9-dee4-4feb-be93-3b317006d034 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:56.435364 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8867ee9-dee4-4feb-be93-3b317006d034 None admin] RBAC: Adding query filter params (role.id=bc70cac1c1b444989feeffc53b52d9ae, scope.project.id=266db3a9097e4be4adb44df90ab84a02, user.id=ae30f19084ad47069c943582b81f1201) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:56.435668 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8867ee9-dee4-4feb-be93-3b317006d034 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:56.437503 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8867ee9-dee4-4feb-be93-3b317006d034 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:56.443476 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 131/260] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 11:48:56 2022] GET /identity/v3/role_assignments?user.id=ae30f19084ad47069c943582b81f1201&scope.project.id=266db3a9097e4be4adb44df90ab84a02&role.id=bc70cac1c1b444989feeffc53b52d9ae => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:56.444310 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8867ee9-dee4-4feb-be93-3b317006d034 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:56.485836 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8a56e-de71-424f-921f-db86bf62402b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:56.487235 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8a56e-de71-424f-921f-db86bf62402b None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:56.487716 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8a56e-de71-424f-921f-db86bf62402b None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:56.488208 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8a56e-de71-424f-921f-db86bf62402b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:56.490473 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8a56e-de71-424f-921f-db86bf62402b None admin] RBAC: Adding query filter params (role.id=d1f3d1431da145709a5e9b374f3b403d, scope.project.id=266db3a9097e4be4adb44df90ab84a02, user.id=6dbe397b3f204f30bb9e5c70b4e474f2) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:56.491211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8a56e-de71-424f-921f-db86bf62402b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:56.494483 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8a56e-de71-424f-921f-db86bf62402b None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:56.516467 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 130/261] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 11:48:56 2022] GET /identity/v3/role_assignments?user.id=6dbe397b3f204f30bb9e5c70b4e474f2&scope.project.id=266db3a9097e4be4adb44df90ab84a02&role.id=d1f3d1431da145709a5e9b374f3b403d => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:56.517829 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8a56e-de71-424f-921f-db86bf62402b None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:56.657802 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8867ee9-dee4-4feb-be93-3b317006d034 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:56.703887 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5edb91-d20b-4060-85f9-b73dff6fe78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:56.704573 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5edb91-d20b-4060-85f9-b73dff6fe78b None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:56.704852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5edb91-d20b-4060-85f9-b73dff6fe78b None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:56.705128 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5edb91-d20b-4060-85f9-b73dff6fe78b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:56.732243 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5edb91-d20b-4060-85f9-b73dff6fe78b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:48:56.743019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-fc5edb91-d20b-4060-85f9-b73dff6fe78b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 11:48:56.743019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:48:56.743019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:48:56.743019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:48:56.743019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:48:56.743019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:48:56.743019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:48:56.743019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:48:56.743019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:48:56.743019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:48:56.743019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:48:56.743019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:48:56.743019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:48:56.743019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:48:56.743019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:48:56.743019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:48:56.744084 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:48:56.744084 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:48:56.744084 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:48:56.744084 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:48:56.744084 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:48:56.744084 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:48:56.744084 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:48:56.744084 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:48:56.744084 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:48:56.744084 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:48:56.744084 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:48:56.744084 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:48:56.744084 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:48:56.744084 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:48:56.744084 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:48:56.744084 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:48:56.744905 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:48:56.744905 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:48:56.744905 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:48:56.744905 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:48:56.744905 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:48:56.744905 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:48:56.744905 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:48:56.744905 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:48:56.744905 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:48:56.744905 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:48:56.744905 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 11:48:56.744905 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:48:56.749234 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 132/262] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 11:48:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:48:56.755165 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5edb91-d20b-4060-85f9-b73dff6fe78b None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:56.778948 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8a56e-de71-424f-921f-db86bf62402b None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:56.810405 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:56.851749 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d3283-710d-45a5-af76-8db62c60121c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:56.852735 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d3283-710d-45a5-af76-8db62c60121c None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:56.853191 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d3283-710d-45a5-af76-8db62c60121c None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:56.853691 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d3283-710d-45a5-af76-8db62c60121c None admin] PATH_INFO: `/v3/projects/266db3a9097e4be4adb44df90ab84a02` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:56.855359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d3283-710d-45a5-af76-8db62c60121c None admin] RBAC: Authorizing `identity:get_project(project_id=266db3a9097e4be4adb44df90ab84a02)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:56.860138 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d3283-710d-45a5-af76-8db62c60121c None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:56.861897 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 131/263] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:48:56 2022] GET /identity/v3/projects/266db3a9097e4be4adb44df90ab84a02 => generated 302 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:56.867603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d3283-710d-45a5-af76-8db62c60121c None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:56.932405 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:56.935277 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5edb91-d20b-4060-85f9-b73dff6fe78b None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:57.002937 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b40f16-4fe4-4eb2-b7c5-7274a0531156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:57.003469 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b40f16-4fe4-4eb2-b7c5-7274a0531156 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:57.003746 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b40f16-4fe4-4eb2-b7c5-7274a0531156 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:57.004108 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b40f16-4fe4-4eb2-b7c5-7274a0531156 None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:57.004846 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b40f16-4fe4-4eb2-b7c5-7274a0531156 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:57.005147 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b40f16-4fe4-4eb2-b7c5-7274a0531156 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:57.006552 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b40f16-4fe4-4eb2-b7c5-7274a0531156 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:57.024325 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 133/264] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:48:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:48:57.033127 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b40f16-4fe4-4eb2-b7c5-7274a0531156 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:57.079220 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d3283-710d-45a5-af76-8db62c60121c None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:57.144865 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6acfea-2690-430c-835f-6c89bab0f3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:57.147977 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6acfea-2690-430c-835f-6c89bab0f3b0 None admin] REQUEST_METHOD: `PUT` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:57.148472 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6acfea-2690-430c-835f-6c89bab0f3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:57.148934 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6acfea-2690-430c-835f-6c89bab0f3b0 None admin] PATH_INFO: `/v3/projects/266db3a9097e4be4adb44df90ab84a02/users/4c02a9254944451fb4ddb3019bbd5b5a/roles/165db5ccce0540569e708b81df7a5577` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:57.152372 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6acfea-2690-430c-835f-6c89bab0f3b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=266db3a9097e4be4adb44df90ab84a02, user_id=4c02a9254944451fb4ddb3019bbd5b5a, role_id=165db5ccce0540569e708b81df7a5577)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:57.155298 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6acfea-2690-430c-835f-6c89bab0f3b0 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:57.180782 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 132/265] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 11:48:56 2022] PUT /identity/v3/projects/266db3a9097e4be4adb44df90ab84a02/users/4c02a9254944451fb4ddb3019bbd5b5a/roles/165db5ccce0540569e708b81df7a5577 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 11:48:57.181525 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:57.209996 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b40f16-4fe4-4eb2-b7c5-7274a0531156 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:57.260507 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb59a1f5-fd12-4a49-aeac-2df594d455c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:57.261603 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59a1f5-fd12-4a49-aeac-2df594d455c4 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:57.262129 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59a1f5-fd12-4a49-aeac-2df594d455c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:57.262598 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59a1f5-fd12-4a49-aeac-2df594d455c4 None admin] PATH_INFO: `/v3/users/6dbe397b3f204f30bb9e5c70b4e474f2` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:57.264407 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb59a1f5-fd12-4a49-aeac-2df594d455c4 None admin] RBAC: Authorizing `identity:get_user(user_id=6dbe397b3f204f30bb9e5c70b4e474f2)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:57.266428 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb59a1f5-fd12-4a49-aeac-2df594d455c4 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:57.268972 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 134/266] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:48:57 2022] GET /identity/v3/users/6dbe397b3f204f30bb9e5c70b4e474f2 => generated 283 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:57.274606 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6acfea-2690-430c-835f-6c89bab0f3b0 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:57.380904 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:57.408282 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6acfea-2690-430c-835f-6c89bab0f3b0 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:57.458496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ddafb-c537-401f-966a-382adbb2d1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:57.459483 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ddafb-c537-401f-966a-382adbb2d1e2 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:57.459952 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ddafb-c537-401f-966a-382adbb2d1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:57.460451 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ddafb-c537-401f-966a-382adbb2d1e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:57.537842 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ddafb-c537-401f-966a-382adbb2d1e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:57.540099 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ddafb-c537-401f-966a-382adbb2d1e2 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:57.643252 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:57.672946 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 133/267] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:48:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:48:57.678686 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb59a1f5-fd12-4a49-aeac-2df594d455c4 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:57.751207 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2c4ef-022a-4444-a189-015f2c93e6c9 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:57.751558 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2c4ef-022a-4444-a189-015f2c93e6c9 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:57.751760 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2c4ef-022a-4444-a189-015f2c93e6c9 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:57.753472 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 134/268] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:57.758666 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c63d7-ebf7-46aa-8860-f22ec12610d1 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:57.758946 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c63d7-ebf7-46aa-8860-f22ec12610d1 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:57.759213 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c63d7-ebf7-46aa-8860-f22ec12610d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:57.778709 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-124c63d7-ebf7-46aa-8860-f22ec12610d1 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:57.779879 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-124c63d7-ebf7-46aa-8860-f22ec12610d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:57.814607 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb59a1f5-fd12-4a49-aeac-2df594d455c4 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:57.851959 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ac3b6-eee1-4623-a6c3-70523ed79366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:57.853879 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ac3b6-eee1-4623-a6c3-70523ed79366 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:57.854059 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ac3b6-eee1-4623-a6c3-70523ed79366 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:57.854133 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 135/269] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 11:48:57.856214 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9e382-630f-4bcb-b48f-2f010584a6d5 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:57.856491 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9e382-630f-4bcb-b48f-2f010584a6d5 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:57.856754 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9e382-630f-4bcb-b48f-2f010584a6d5 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:57.858363 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 136/270] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:57.860333 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ac3b6-eee1-4623-a6c3-70523ed79366 None admin] PATH_INFO: `/v3/projects/266db3a9097e4be4adb44df90ab84a02` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:57.861579 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ac3b6-eee1-4623-a6c3-70523ed79366 None admin] RBAC: Authorizing `identity:get_project(project_id=266db3a9097e4be4adb44df90ab84a02)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:57.863407 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f64c71-2b78-44f4-b4ec-f6bc9d75382b None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:57.863676 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f64c71-2b78-44f4-b4ec-f6bc9d75382b None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:57.863939 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f64c71-2b78-44f4-b4ec-f6bc9d75382b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:57.867256 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ac3b6-eee1-4623-a6c3-70523ed79366 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:57.869119 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 135/271] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:48:57 2022] GET /identity/v3/projects/266db3a9097e4be4adb44df90ab84a02 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:57.876024 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ac3b6-eee1-4623-a6c3-70523ed79366 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:57.900390 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-34f64c71-2b78-44f4-b4ec-f6bc9d75382b None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:57.901562 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-34f64c71-2b78-44f4-b4ec-f6bc9d75382b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:57.912625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:57.974657 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 137/272] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:48:58.031734 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ac3b6-eee1-4623-a6c3-70523ed79366 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:58.079503 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab6969-4f37-4df5-9e8d-e2550b8b23b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:58.080361 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab6969-4f37-4df5-9e8d-e2550b8b23b0 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:58.080777 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab6969-4f37-4df5-9e8d-e2550b8b23b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:58.081186 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab6969-4f37-4df5-9e8d-e2550b8b23b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:58.082049 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab6969-4f37-4df5-9e8d-e2550b8b23b0 None admin] RBAC: Adding query filter params (role.id=c163d39b46d24a27a76fb9026fec24ff, scope.project.id=266db3a9097e4be4adb44df90ab84a02, user.id=6dbe397b3f204f30bb9e5c70b4e474f2) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:58.082491 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab6969-4f37-4df5-9e8d-e2550b8b23b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:58.084112 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab6969-4f37-4df5-9e8d-e2550b8b23b0 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:58.096449 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 136/273] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 11:48:57 2022] GET /identity/v3/role_assignments?user.id=6dbe397b3f204f30bb9e5c70b4e474f2&scope.project.id=266db3a9097e4be4adb44df90ab84a02&role.id=c163d39b46d24a27a76fb9026fec24ff => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:48:58.200980 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f64c71-2b78-44f4-b4ec-f6bc9d75382b None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:58.254889 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:58.326537 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f64c71-2b78-44f4-b4ec-f6bc9d75382b None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:58.364136 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db6dfb-c0fc-4bac-8616-a365e060a984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:58.364687 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db6dfb-c0fc-4bac-8616-a365e060a984 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:58.364959 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db6dfb-c0fc-4bac-8616-a365e060a984 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:58.365227 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db6dfb-c0fc-4bac-8616-a365e060a984 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:58.366317 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db6dfb-c0fc-4bac-8616-a365e060a984 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:58.367755 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db6dfb-c0fc-4bac-8616-a365e060a984 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:58.369635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 138/274] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:48:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:58.375132 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab6969-4f37-4df5-9e8d-e2550b8b23b0 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:58.387629 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db6dfb-c0fc-4bac-8616-a365e060a984 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:58.504512 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:58.527379 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db6dfb-c0fc-4bac-8616-a365e060a984 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:58.528583 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab6969-4f37-4df5-9e8d-e2550b8b23b0 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:58.539783 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:58.574844 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8f6a8-2598-4756-9fff-f90fbdbdb5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:58.575395 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89315656-328b-4d52-88a6-9498f3e3e754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:58.575541 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8f6a8-2598-4756-9fff-f90fbdbdb5d6 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:58.575726 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8f6a8-2598-4756-9fff-f90fbdbdb5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:58.575977 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8f6a8-2598-4756-9fff-f90fbdbdb5d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:58.576091 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89315656-328b-4d52-88a6-9498f3e3e754 None admin] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:58.576310 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89315656-328b-4d52-88a6-9498f3e3e754 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:58.576641 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89315656-328b-4d52-88a6-9498f3e3e754 None admin] PATH_INFO: `/v3/users` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:58.579787 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89315656-328b-4d52-88a6-9498f3e3e754 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:58.579787 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89315656-328b-4d52-88a6-9498f3e3e754 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:58.588025 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8f6a8-2598-4756-9fff-f90fbdbdb5d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:48:58.596149 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-acf8f6a8-2598-4756-9fff-f90fbdbdb5d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:48:58.596149 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:48:58.596149 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:48:58.596149 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:48:58.596149 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:48:58.596149 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:48:58.596149 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:48:58.596149 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:48:58.596149 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:48:58.596149 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:48:58.596149 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:48:58.596149 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:48:58.596149 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:48:58.596149 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:48:58.596149 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:48:58.596149 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:48:58.597053 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:48:58.597053 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:48:58.597053 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:48:58.597053 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:48:58.597053 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:48:58.597053 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:48:58.597053 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:48:58.597053 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:48:58.597053 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:48:58.597053 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:48:58.597053 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:48:58.597053 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:48:58.597053 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:48:58.597053 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:48:58.597053 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:48:58.597053 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:48:58.598156 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:48:58.598156 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:48:58.598156 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:48:58.598156 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:48:58.598156 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:48:58.598156 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:48:58.598156 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:48:58.598156 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:48:58.598156 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:48:58.598156 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:48:58.598156 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:48:58.598156 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:48:58.598156 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 139/275] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:48:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 11:48:58.602326 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8f6a8-2598-4756-9fff-f90fbdbdb5d6 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:58.619766 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 137/276] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 21 11:48:58 2022] POST /identity/v3/users => generated 293 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 11:48:58.734058 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8f6a8-2598-4756-9fff-f90fbdbdb5d6 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:58.781905 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d3820-7589-4c16-a6de-0d710c002b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:58.782520 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d3820-7589-4c16-a6de-0d710c002b6b None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:58.782790 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d3820-7589-4c16-a6de-0d710c002b6b None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:58.783050 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d3820-7589-4c16-a6de-0d710c002b6b None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:58.783721 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d3820-7589-4c16-a6de-0d710c002b6b None admin] RBAC: Adding query filter params (name=member) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:58.784055 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d3820-7589-4c16-a6de-0d710c002b6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:58.785446 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d3820-7589-4c16-a6de-0d710c002b6b None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:58.795671 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 140/277] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 11:48:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:58.801277 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89315656-328b-4d52-88a6-9498f3e3e754 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:58.909809 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89315656-328b-4d52-88a6-9498f3e3e754 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:58.946714 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2e74f-b943-493d-a3a2-7b814b39e3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:58.947340 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2e74f-b943-493d-a3a2-7b814b39e3f2 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:58.947614 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2e74f-b943-493d-a3a2-7b814b39e3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:58.947882 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2e74f-b943-493d-a3a2-7b814b39e3f2 None admin] PATH_INFO: `/v3/users/d953714cafdf46239e9d11d6b69ebcff` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:58.956290 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:58.963374 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2e74f-b943-493d-a3a2-7b814b39e3f2 None admin] RBAC: Authorizing `identity:get_user(user_id=d953714cafdf46239e9d11d6b69ebcff)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:58.965804 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2e74f-b943-493d-a3a2-7b814b39e3f2 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:58.967543 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 138/278] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:48:58 2022] GET /identity/v3/users/d953714cafdf46239e9d11d6b69ebcff => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:58.973309 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d3820-7589-4c16-a6de-0d710c002b6b None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:48:59.007533 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:48:59.083705 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d3820-7589-4c16-a6de-0d710c002b6b None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:48:59.120305 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f76f08-b766-4643-918a-e663cb30e11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:48:59.120967 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f76f08-b766-4643-918a-e663cb30e11e None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:59.121241 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f76f08-b766-4643-918a-e663cb30e11e None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:59.121510 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f76f08-b766-4643-918a-e663cb30e11e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:59.122229 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f76f08-b766-4643-918a-e663cb30e11e None admin] RBAC: Adding query filter params (role.id=165db5ccce0540569e708b81df7a5577, user.id=d953714cafdf46239e9d11d6b69ebcff, scope.system=all) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:48:59.122537 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f76f08-b766-4643-918a-e663cb30e11e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:48:59.124002 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f76f08-b766-4643-918a-e663cb30e11e None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:48:59.129531 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 141/279] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Sep 21 11:48:58 2022] GET /identity/v3/role_assignments?user.id=d953714cafdf46239e9d11d6b69ebcff&scope.system=all&role.id=165db5ccce0540569e708b81df7a5577 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:48:59.613720 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe81400-38fd-41c4-b34b-57098fffb63f None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:59.614363 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe81400-38fd-41c4-b34b-57098fffb63f None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:59.614824 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe81400-38fd-41c4-b34b-57098fffb63f None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:59.616404 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 139/280] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:48:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:48:59.621874 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c29a17-366a-4b91-81a7-0e79f7cd1735 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:48:59.622349 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c29a17-366a-4b91-81a7-0e79f7cd1735 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:48:59.622448 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c29a17-366a-4b91-81a7-0e79f7cd1735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:48:59.645445 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-a7c29a17-366a-4b91-81a7-0e79f7cd1735 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:48:59.646637 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-a7c29a17-366a-4b91-81a7-0e79f7cd1735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:48:59.743029 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 142/281] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:48:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:49:00.176121 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe81400-38fd-41c4-b34b-57098fffb63f None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:00.320402 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe81400-38fd-41c4-b34b-57098fffb63f None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:00.364643 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451e228-f232-44c9-997c-ca025fc26db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:00.365625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451e228-f232-44c9-997c-ca025fc26db9 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:00.366092 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451e228-f232-44c9-997c-ca025fc26db9 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:00.366548 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451e228-f232-44c9-997c-ca025fc26db9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:00.381293 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451e228-f232-44c9-997c-ca025fc26db9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:00.382777 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a6c2c-4025-48c0-8218-8a3b7519d4b7 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:00.383066 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a6c2c-4025-48c0-8218-8a3b7519d4b7 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:00.383342 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a6c2c-4025-48c0-8218-8a3b7519d4b7 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:00.387209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-6451e228-f232-44c9-997c-ca025fc26db9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 11:49:00.387209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:00.387209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:00.387209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:00.387209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:00.387209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:00.387209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:00.387209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:00.387209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:00.387209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:00.387209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:00.387209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:00.387209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:00.387209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:00.387209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:00.387209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:00.388201 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:00.388201 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:00.388201 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:00.388201 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:00.388201 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:00.388201 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:00.388201 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:00.388201 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:00.388201 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:00.388201 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:00.388201 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:00.388201 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:00.388201 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:00.388201 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:00.388201 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:00.388201 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:00.389018 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:00.389018 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:00.389018 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:00.389018 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:00.389018 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:00.389018 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:00.389018 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:00.389018 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:00.389018 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:00.389018 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:00.389018 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 11:49:00.389018 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:00.389639 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 143/282] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:00.389707 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbab41-e438-45d6-83ce-5ee3a23168f6 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:00.390309 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbab41-e438-45d6-83ce-5ee3a23168f6 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:00.390309 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbab41-e438-45d6-83ce-5ee3a23168f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:00.391759 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 140/283] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:49:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:00.397422 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451e228-f232-44c9-997c-ca025fc26db9 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:00.441107 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-2ccbab41-e438-45d6-83ce-5ee3a23168f6 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:00.442267 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-2ccbab41-e438-45d6-83ce-5ee3a23168f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:00.467688 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:00.511535 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:00.517634 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451e228-f232-44c9-997c-ca025fc26db9 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:00.556493 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db755056-7bff-49e0-bb72-d3e42d2da175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:00.557502 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db755056-7bff-49e0-bb72-d3e42d2da175 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:00.557972 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db755056-7bff-49e0-bb72-d3e42d2da175 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:00.558475 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db755056-7bff-49e0-bb72-d3e42d2da175 None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:00.559396 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db755056-7bff-49e0-bb72-d3e42d2da175 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:00.559902 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db755056-7bff-49e0-bb72-d3e42d2da175 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:00.561602 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db755056-7bff-49e0-bb72-d3e42d2da175 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:00.576017 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 141/284] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 11:49:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:49:00.578046 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db755056-7bff-49e0-bb72-d3e42d2da175 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:00.649809 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 144/285] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:49:00.709810 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db755056-7bff-49e0-bb72-d3e42d2da175 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:00.730944 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:00.745089 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a823c43-7994-463d-b5b5-e84a36059562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:00.745828 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a823c43-7994-463d-b5b5-e84a36059562 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:00.746162 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a823c43-7994-463d-b5b5-e84a36059562 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:00.746499 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a823c43-7994-463d-b5b5-e84a36059562 None admin] PATH_INFO: `/v3/users/ae30f19084ad47069c943582b81f1201` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:00.747685 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a823c43-7994-463d-b5b5-e84a36059562 None admin] RBAC: Authorizing `identity:get_user(user_id=ae30f19084ad47069c943582b81f1201)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:00.749213 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a823c43-7994-463d-b5b5-e84a36059562 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:00.751158 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 142/286] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:49:00 2022] GET /identity/v3/users/ae30f19084ad47069c943582b81f1201 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:49:00.756721 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbab41-e438-45d6-83ce-5ee3a23168f6 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:00.870785 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbab41-e438-45d6-83ce-5ee3a23168f6 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:00.908588 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8bb92-394c-4853-afc8-f227a7734b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:00.909210 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8bb92-394c-4853-afc8-f227a7734b86 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:00.909480 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8bb92-394c-4853-afc8-f227a7734b86 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:00.909743 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8bb92-394c-4853-afc8-f227a7734b86 None admin] PATH_INFO: `/v3/projects/266db3a9097e4be4adb44df90ab84a02` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:00.910858 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8bb92-394c-4853-afc8-f227a7734b86 None admin] RBAC: Authorizing `identity:get_project(project_id=266db3a9097e4be4adb44df90ab84a02)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:00.912393 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8bb92-394c-4853-afc8-f227a7734b86 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:00.914379 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 145/287] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:49:00 2022] GET /identity/v3/projects/266db3a9097e4be4adb44df90ab84a02 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:00.921223 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a823c43-7994-463d-b5b5-e84a36059562 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:01.027830 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8bb92-394c-4853-afc8-f227a7734b86 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:01.074546 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:01.078405 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a823c43-7994-463d-b5b5-e84a36059562 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:01.144733 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c666be8-eb21-4540-bc43-e7a059327a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:01.145390 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c666be8-eb21-4540-bc43-e7a059327a85 None admin] REQUEST_METHOD: `PUT` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:01.145664 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c666be8-eb21-4540-bc43-e7a059327a85 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:01.145933 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c666be8-eb21-4540-bc43-e7a059327a85 None admin] PATH_INFO: `/v3/projects/266db3a9097e4be4adb44df90ab84a02/users/ae30f19084ad47069c943582b81f1201/roles/bc70cac1c1b444989feeffc53b52d9ae` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:01.150194 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c666be8-eb21-4540-bc43-e7a059327a85 None admin] RBAC: Authorizing `identity:create_grant(project_id=266db3a9097e4be4adb44df90ab84a02, user_id=ae30f19084ad47069c943582b81f1201, role_id=bc70cac1c1b444989feeffc53b52d9ae)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:01.151632 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c666be8-eb21-4540-bc43-e7a059327a85 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:01.176135 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 143/288] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 11:49:00 2022] PUT /identity/v3/projects/266db3a9097e4be4adb44df90ab84a02/users/ae30f19084ad47069c943582b81f1201/roles/bc70cac1c1b444989feeffc53b52d9ae => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 11:49:01.201665 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8bb92-394c-4853-afc8-f227a7734b86 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:01.241568 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbabec-52d3-4f2a-92d7-fce164214e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:01.242265 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbabec-52d3-4f2a-92d7-fce164214e7a None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:01.242543 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbabec-52d3-4f2a-92d7-fce164214e7a None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:01.242811 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbabec-52d3-4f2a-92d7-fce164214e7a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:01.255947 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cbabec-52d3-4f2a-92d7-fce164214e7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:01.261093 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-38cbabec-52d3-4f2a-92d7-fce164214e7a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:49:01.261093 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:01.261093 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:01.261093 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:01.261093 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:01.261093 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:01.261093 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:01.261093 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:01.261093 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:01.261093 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:01.261093 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:01.261093 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:01.261093 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:01.261093 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:01.261093 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:01.261093 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:01.262082 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:01.262082 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:01.262082 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:01.262082 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:01.262082 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:01.262082 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:01.262082 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:01.262082 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:01.262082 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:01.262082 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:01.262082 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:01.262082 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:01.262082 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:01.262082 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:01.262082 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:01.262082 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:01.262894 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:01.262894 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:01.262894 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:01.262894 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:01.262894 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:01.262894 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:01.262894 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:01.262894 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:01.262894 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:01.262894 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:01.262894 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:49:01.262894 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:01.262894 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 146/289] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:49:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:01.268616 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c666be8-eb21-4540-bc43-e7a059327a85 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:01.323148 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:01.385287 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c666be8-eb21-4540-bc43-e7a059327a85 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:01.425171 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c5b0d-0089-4545-9420-1892b91063f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:01.425795 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c5b0d-0089-4545-9420-1892b91063f4 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:01.426071 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c5b0d-0089-4545-9420-1892b91063f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:01.426340 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c5b0d-0089-4545-9420-1892b91063f4 None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:01.427019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c5b0d-0089-4545-9420-1892b91063f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:01.427321 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c5b0d-0089-4545-9420-1892b91063f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:01.428819 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c5b0d-0089-4545-9420-1892b91063f4 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:01.439562 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 144/290] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 11:49:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:49:01.445489 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbabec-52d3-4f2a-92d7-fce164214e7a None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:01.539917 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:01.558609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbabec-52d3-4f2a-92d7-fce164214e7a None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:01.630125 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11417ec1-6d97-479e-85bc-ecc6c4c5bc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:01.630758 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11417ec1-6d97-479e-85bc-ecc6c4c5bc5c None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:01.631031 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11417ec1-6d97-479e-85bc-ecc6c4c5bc5c None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:01.631297 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11417ec1-6d97-479e-85bc-ecc6c4c5bc5c None admin] PATH_INFO: `/v3/users/4c02a9254944451fb4ddb3019bbd5b5a` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:01.636898 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11417ec1-6d97-479e-85bc-ecc6c4c5bc5c None admin] RBAC: Authorizing `identity:get_user(user_id=4c02a9254944451fb4ddb3019bbd5b5a)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:01.638389 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11417ec1-6d97-479e-85bc-ecc6c4c5bc5c None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:01.640411 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 147/291] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:49:01 2022] GET /identity/v3/users/4c02a9254944451fb4ddb3019bbd5b5a => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:01.646103 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c5b0d-0089-4545-9420-1892b91063f4 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:01.763487 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c5b0d-0089-4545-9420-1892b91063f4 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:01.772829 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:01.786769 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e01b97-4e55-4fa9-937d-ba7d20d39a33 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:01.787272 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e01b97-4e55-4fa9-937d-ba7d20d39a33 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:01.787523 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e01b97-4e55-4fa9-937d-ba7d20d39a33 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:01.788884 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 148/292] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:01.794949 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf7533-82a9-408c-9315-67cc9b9e7b75 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:01.795230 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf7533-82a9-408c-9315-67cc9b9e7b75 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:01.795504 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf7533-82a9-408c-9315-67cc9b9e7b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:01.799797 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c1937-ce46-47aa-9b62-28ed5ce7586e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:01.800536 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c1937-ce46-47aa-9b62-28ed5ce7586e None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:01.800822 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c1937-ce46-47aa-9b62-28ed5ce7586e None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:01.801093 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c1937-ce46-47aa-9b62-28ed5ce7586e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:01.841324 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-6bcf7533-82a9-408c-9315-67cc9b9e7b75 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:01.842683 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-6bcf7533-82a9-408c-9315-67cc9b9e7b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:01.888574 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c1937-ce46-47aa-9b62-28ed5ce7586e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:01.890058 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c1937-ce46-47aa-9b62-28ed5ce7586e None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:01.995819 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 149/293] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:49:02.002037 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 145/294] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:49:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:49:02.007374 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf7533-82a9-408c-9315-67cc9b9e7b75 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:02.137166 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:02.165961 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf7533-82a9-408c-9315-67cc9b9e7b75 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:02.181391 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6dfb99-573b-404e-838c-875175d459f0 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:02.181988 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6dfb99-573b-404e-838c-875175d459f0 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:02.181988 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6dfb99-573b-404e-838c-875175d459f0 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:02.183691 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 146/295] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 11:49:02.189124 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801cf77-7adb-4220-976c-f0c85bde4bf3 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:02.189475 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801cf77-7adb-4220-976c-f0c85bde4bf3 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:02.189726 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801cf77-7adb-4220-976c-f0c85bde4bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:02.212649 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-d801cf77-7adb-4220-976c-f0c85bde4bf3 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:02.213918 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-d801cf77-7adb-4220-976c-f0c85bde4bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:02.216879 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:02.234597 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf7e8a-c6fb-4206-b755-9819ab9ba459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:02.235618 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf7e8a-c6fb-4206-b755-9819ab9ba459 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:02.236127 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf7e8a-c6fb-4206-b755-9819ab9ba459 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:02.236613 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf7e8a-c6fb-4206-b755-9819ab9ba459 None admin] PATH_INFO: `/v3/projects/266db3a9097e4be4adb44df90ab84a02` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:02.237998 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf7e8a-c6fb-4206-b755-9819ab9ba459 None admin] RBAC: Authorizing `identity:get_project(project_id=266db3a9097e4be4adb44df90ab84a02)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:02.239847 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf7e8a-c6fb-4206-b755-9819ab9ba459 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:02.241989 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 150/296] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:49:02 2022] GET /identity/v3/projects/266db3a9097e4be4adb44df90ab84a02 => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:02.247550 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf7e8a-c6fb-4206-b755-9819ab9ba459 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:02.331329 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 147/297] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 11:49:02.332982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4e252-b018-4edd-88bf-83cda6bc31ce None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:02.333462 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4e252-b018-4edd-88bf-83cda6bc31ce None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:02.333924 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4e252-b018-4edd-88bf-83cda6bc31ce None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:02.335592 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 148/298] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:02.353189 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea5357-aa9e-4d34-8a12-156db90f47cb None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:02.353776 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea5357-aa9e-4d34-8a12-156db90f47cb None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:02.354246 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea5357-aa9e-4d34-8a12-156db90f47cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:02.374040 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf7e8a-c6fb-4206-b755-9819ab9ba459 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:02.381652 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-f2ea5357-aa9e-4d34-8a12-156db90f47cb None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:02.383049 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-f2ea5357-aa9e-4d34-8a12-156db90f47cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:02.441801 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956ece6-1df7-40ad-b630-c1754f97b2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:02.442377 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956ece6-1df7-40ad-b630-c1754f97b2ae None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:02.442653 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956ece6-1df7-40ad-b630-c1754f97b2ae None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:02.442922 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956ece6-1df7-40ad-b630-c1754f97b2ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:02.443762 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956ece6-1df7-40ad-b630-c1754f97b2ae None admin] RBAC: Adding query filter params (role.id=165db5ccce0540569e708b81df7a5577, scope.project.id=266db3a9097e4be4adb44df90ab84a02, user.id=4c02a9254944451fb4ddb3019bbd5b5a) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:02.444093 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956ece6-1df7-40ad-b630-c1754f97b2ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:02.445872 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956ece6-1df7-40ad-b630-c1754f97b2ae None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:02.458172 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 151/299] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 11:49:02 2022] GET /identity/v3/role_assignments?user.id=4c02a9254944451fb4ddb3019bbd5b5a&scope.project.id=266db3a9097e4be4adb44df90ab84a02&role.id=165db5ccce0540569e708b81df7a5577 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:02.461804 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 149/300] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 11:49:02.524796 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956ece6-1df7-40ad-b630-c1754f97b2ae None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:02.548838 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:02.687411 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956ece6-1df7-40ad-b630-c1754f97b2ae None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:02.732585 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f4cd4-df63-47bf-a5a3-d6e991b0db1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:02.733139 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f4cd4-df63-47bf-a5a3-d6e991b0db1f None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:02.733413 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f4cd4-df63-47bf-a5a3-d6e991b0db1f None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:02.733682 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f4cd4-df63-47bf-a5a3-d6e991b0db1f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:02.744300 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f4cd4-df63-47bf-a5a3-d6e991b0db1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:02.749779 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-312f4cd4-df63-47bf-a5a3-d6e991b0db1f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 11:49:02.749779 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:02.749779 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:02.749779 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:02.749779 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:02.749779 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:02.749779 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:02.749779 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:02.749779 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:02.749779 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:02.749779 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:02.749779 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:02.749779 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:02.749779 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:02.749779 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:02.749779 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:02.750681 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:02.750681 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:02.750681 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:02.750681 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:02.750681 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:02.750681 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:02.750681 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:02.750681 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:02.750681 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:02.750681 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:02.750681 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:02.750681 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:02.750681 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:02.750681 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:02.750681 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:02.750681 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:02.752075 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:02.752075 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:02.752075 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:02.752075 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:02.752075 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:02.752075 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:02.752075 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:02.752075 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:02.752075 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:02.752075 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:02.752075 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 11:49:02.752075 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:02.752075 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 152/301] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:49:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:02.756797 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea5357-aa9e-4d34-8a12-156db90f47cb None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:02.770538 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f4cd4-df63-47bf-a5a3-d6e991b0db1f None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:02.837527 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:02.875725 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea5357-aa9e-4d34-8a12-156db90f47cb None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:02.880586 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:02.910658 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f4cd4-df63-47bf-a5a3-d6e991b0db1f None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:02.920491 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b5cfb-3020-4ea4-9a90-a198f001f204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:02.921428 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b5cfb-3020-4ea4-9a90-a198f001f204 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:02.921902 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b5cfb-3020-4ea4-9a90-a198f001f204 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:02.922387 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b5cfb-3020-4ea4-9a90-a198f001f204 None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:02.923234 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b5cfb-3020-4ea4-9a90-a198f001f204 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:02.923700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b5cfb-3020-4ea4-9a90-a198f001f204 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:02.925542 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b5cfb-3020-4ea4-9a90-a198f001f204 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:02.936063 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 150/302] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 11:49:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:02.937487 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b5cfb-3020-4ea4-9a90-a198f001f204 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:02.950749 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d346f-a051-4051-8229-5cd7d8f2a94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:02.951375 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d346f-a051-4051-8229-5cd7d8f2a94f None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:02.951649 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d346f-a051-4051-8229-5cd7d8f2a94f None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:02.951916 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d346f-a051-4051-8229-5cd7d8f2a94f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:02.953058 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d346f-a051-4051-8229-5cd7d8f2a94f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:02.954505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d346f-a051-4051-8229-5cd7d8f2a94f None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:02.956114 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 153/303] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:02.956861 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d346f-a051-4051-8229-5cd7d8f2a94f None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:03.056862 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b5cfb-3020-4ea4-9a90-a198f001f204 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:03.069891 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d346f-a051-4051-8229-5cd7d8f2a94f None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:03.092280 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:03.100628 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538f64b-c6be-45d9-8628-700def398ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:03.101496 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538f64b-c6be-45d9-8628-700def398ed4 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:03.101976 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538f64b-c6be-45d9-8628-700def398ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:03.102444 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538f64b-c6be-45d9-8628-700def398ed4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:03.104170 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10adbb-094e-4495-88e6-b098170c2157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:03.104790 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10adbb-094e-4495-88e6-b098170c2157 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:03.105698 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10adbb-094e-4495-88e6-b098170c2157 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:03.105964 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10adbb-094e-4495-88e6-b098170c2157 None admin] PATH_INFO: `/v3/users/143e425e57174364a3d50fb7f69b021e` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:03.116010 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538f64b-c6be-45d9-8628-700def398ed4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:03.117380 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:03.120291 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10adbb-094e-4495-88e6-b098170c2157 None admin] RBAC: Authorizing `identity:get_user(user_id=143e425e57174364a3d50fb7f69b021e)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:03.122586 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-1538f64b-c6be-45d9-8628-700def398ed4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:49:03.122586 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:03.122586 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:03.122586 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:03.122586 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:03.122586 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:03.122586 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:03.122586 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:03.122586 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:03.122586 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:03.122586 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:03.122586 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:03.122586 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:03.122586 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:03.122586 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:03.122586 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:03.123497 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:03.123497 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:03.123497 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:03.123497 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:03.123497 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:03.123497 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:03.123497 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:03.123497 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:03.123497 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:03.123497 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:03.123497 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:03.123497 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:03.123497 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:03.123497 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:03.123497 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:03.123497 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:03.124758 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:03.124758 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:03.124758 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:03.124758 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:03.124758 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:03.124758 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:03.124758 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:03.124758 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:03.124758 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:03.124758 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:03.124758 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:49:03.124758 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:03.125366 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10adbb-094e-4495-88e6-b098170c2157 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:03.125515 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 151/304] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:49:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:03.125515 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538f64b-c6be-45d9-8628-700def398ed4 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:03.130429 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 154/305] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:49:02 2022] GET /identity/v3/users/143e425e57174364a3d50fb7f69b021e => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:03.131432 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10adbb-094e-4495-88e6-b098170c2157 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:03.229393 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538f64b-c6be-45d9-8628-700def398ed4 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:03.234538 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10adbb-094e-4495-88e6-b098170c2157 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:03.263221 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae6e62-ee8b-410f-bddd-72eb827c6023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:03.263832 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae6e62-ee8b-410f-bddd-72eb827c6023 None admin] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:03.264143 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae6e62-ee8b-410f-bddd-72eb827c6023 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:03.264415 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae6e62-ee8b-410f-bddd-72eb827c6023 None admin] PATH_INFO: `/v3/groups` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:03.265032 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae6e62-ee8b-410f-bddd-72eb827c6023 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:03.266466 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae6e62-ee8b-410f-bddd-72eb827c6023 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:03.272107 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18c962-1ab1-41a6-bc1a-d5bf5964331d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:03.272795 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18c962-1ab1-41a6-bc1a-d5bf5964331d None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:03.273135 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18c962-1ab1-41a6-bc1a-d5bf5964331d None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:03.273337 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18c962-1ab1-41a6-bc1a-d5bf5964331d None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:03.274040 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18c962-1ab1-41a6-bc1a-d5bf5964331d None admin] RBAC: Adding query filter params (name=member) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:03.274372 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18c962-1ab1-41a6-bc1a-d5bf5964331d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:03.275812 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18c962-1ab1-41a6-bc1a-d5bf5964331d None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:03.282552 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 152/306] 10.222.0.27 () {60 vars in 1134 bytes} [Wed Sep 21 11:49:03 2022] POST /identity/v3/groups => generated 229 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 11:49:03.283190 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae6e62-ee8b-410f-bddd-72eb827c6023 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:03.286469 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 155/307] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 11:49:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:03.293015 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18c962-1ab1-41a6-bc1a-d5bf5964331d None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:03.367177 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:03.396893 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:03.421899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18c962-1ab1-41a6-bc1a-d5bf5964331d None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:03.436783 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae6e62-ee8b-410f-bddd-72eb827c6023 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:03.463604 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aac8b2-9515-4cde-b4cc-9e5d6244869c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:03.464921 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aac8b2-9515-4cde-b4cc-9e5d6244869c None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:03.465270 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aac8b2-9515-4cde-b4cc-9e5d6244869c None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:03.465546 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aac8b2-9515-4cde-b4cc-9e5d6244869c None admin] PATH_INFO: `/v3/users/d953714cafdf46239e9d11d6b69ebcff` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:03.467278 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aac8b2-9515-4cde-b4cc-9e5d6244869c None admin] RBAC: Authorizing `identity:get_user(user_id=d953714cafdf46239e9d11d6b69ebcff)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:03.469108 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aac8b2-9515-4cde-b4cc-9e5d6244869c None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:03.475723 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 156/308] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:49:03 2022] GET /identity/v3/users/d953714cafdf46239e9d11d6b69ebcff => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:03.476857 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aac8b2-9515-4cde-b4cc-9e5d6244869c None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:03.482893 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973c9d6-be8e-49de-ab67-bd8fc7006e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:03.483590 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973c9d6-be8e-49de-ab67-bd8fc7006e26 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:03.483937 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973c9d6-be8e-49de-ab67-bd8fc7006e26 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:03.484311 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973c9d6-be8e-49de-ab67-bd8fc7006e26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:03.485110 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973c9d6-be8e-49de-ab67-bd8fc7006e26 None admin] RBAC: Adding query filter params (role.id=bc70cac1c1b444989feeffc53b52d9ae, user.id=143e425e57174364a3d50fb7f69b021e, scope.system=all) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:03.485499 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973c9d6-be8e-49de-ab67-bd8fc7006e26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:03.487695 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973c9d6-be8e-49de-ab67-bd8fc7006e26 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:03.494573 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 153/309] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Sep 21 11:49:03 2022] GET /identity/v3/role_assignments?user.id=143e425e57174364a3d50fb7f69b021e&scope.system=all&role.id=bc70cac1c1b444989feeffc53b52d9ae => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:03.603019 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aac8b2-9515-4cde-b4cc-9e5d6244869c None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:03.646025 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:03.653714 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8c926-2638-458e-a345-3222c48abd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:03.654388 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8c926-2638-458e-a345-3222c48abd06 None admin] REQUEST_METHOD: `PUT` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:03.654668 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8c926-2638-458e-a345-3222c48abd06 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:03.654938 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8c926-2638-458e-a345-3222c48abd06 None admin] PATH_INFO: `/v3/system/users/d953714cafdf46239e9d11d6b69ebcff/roles/165db5ccce0540569e708b81df7a5577` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:03.656455 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8c926-2638-458e-a345-3222c48abd06 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d953714cafdf46239e9d11d6b69ebcff, role_id=165db5ccce0540569e708b81df7a5577)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:03.657970 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8c926-2638-458e-a345-3222c48abd06 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:03.670929 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 157/310] 10.222.0.27 () {58 vars in 1334 bytes} [Wed Sep 21 11:49:03 2022] PUT /identity/v3/system/users/d953714cafdf46239e9d11d6b69ebcff/roles/165db5ccce0540569e708b81df7a5577 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 11:49:04.062264 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f36a1-6466-4d9a-affd-e5d0ea2746d7 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:04.062917 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f36a1-6466-4d9a-affd-e5d0ea2746d7 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:04.063439 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f36a1-6466-4d9a-affd-e5d0ea2746d7 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:04.065273 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 154/311] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:04.070837 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b98ad8-337a-4544-9436-8e90a14ea536 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:04.071725 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b98ad8-337a-4544-9436-8e90a14ea536 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:04.072235 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b98ad8-337a-4544-9436-8e90a14ea536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:04.092165 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-e8b98ad8-337a-4544-9436-8e90a14ea536 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:04.093677 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-e8b98ad8-337a-4544-9436-8e90a14ea536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:04.162917 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 158/312] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:49:04.484492 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f36a1-6466-4d9a-affd-e5d0ea2746d7 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:04.592204 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f36a1-6466-4d9a-affd-e5d0ea2746d7 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:04.604780 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:04.622762 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc4ee6-f485-4774-9fc2-70492a355e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:04.623387 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc4ee6-f485-4774-9fc2-70492a355e48 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:04.623669 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc4ee6-f485-4774-9fc2-70492a355e48 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:04.623957 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc4ee6-f485-4774-9fc2-70492a355e48 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:04.635307 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc4ee6-f485-4774-9fc2-70492a355e48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:04.640572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-39bc4ee6-f485-4774-9fc2-70492a355e48 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 11:49:04.640572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:04.640572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:04.640572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:04.640572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:04.640572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:04.640572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:04.640572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:04.640572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:04.640572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:04.640572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:04.640572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:04.640572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:04.640572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:04.640572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:04.640572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:04.641555 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:04.641555 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:04.641555 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:04.641555 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:04.641555 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:04.641555 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:04.641555 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:04.641555 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:04.641555 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:04.641555 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:04.641555 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:04.641555 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:04.641555 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:04.641555 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:04.641555 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:04.641555 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:04.642989 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:04.642989 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:04.642989 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:04.642989 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:04.642989 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:04.642989 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:04.642989 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:04.642989 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:04.642989 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:04.642989 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:04.642989 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 11:49:04.642989 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:04.642989 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 155/313] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:49:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:04.647777 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b98ad8-337a-4544-9436-8e90a14ea536 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:04.755025 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b98ad8-337a-4544-9436-8e90a14ea536 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:04.780193 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:04.795727 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72040ed1-1018-4b2f-9f9f-e7b36980a50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:04.796530 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72040ed1-1018-4b2f-9f9f-e7b36980a50a None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:04.796803 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72040ed1-1018-4b2f-9f9f-e7b36980a50a None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:04.797072 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72040ed1-1018-4b2f-9f9f-e7b36980a50a None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:04.797748 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72040ed1-1018-4b2f-9f9f-e7b36980a50a None admin] RBAC: Adding query filter params (name=reader) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:04.798044 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72040ed1-1018-4b2f-9f9f-e7b36980a50a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:04.799430 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72040ed1-1018-4b2f-9f9f-e7b36980a50a None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:04.809322 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 159/314] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 11:49:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:04.814940 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc4ee6-f485-4774-9fc2-70492a355e48 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:04.920333 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc4ee6-f485-4774-9fc2-70492a355e48 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:04.958693 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167040a-b0e0-410c-a089-76aa3bcfc68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:04.959319 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167040a-b0e0-410c-a089-76aa3bcfc68f None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:04.959600 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167040a-b0e0-410c-a089-76aa3bcfc68f None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:04.959871 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167040a-b0e0-410c-a089-76aa3bcfc68f None admin] PATH_INFO: `/v3/users/ae30f19084ad47069c943582b81f1201` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:04.961032 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167040a-b0e0-410c-a089-76aa3bcfc68f None admin] RBAC: Authorizing `identity:get_user(user_id=ae30f19084ad47069c943582b81f1201)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:04.962518 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167040a-b0e0-410c-a089-76aa3bcfc68f None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:04.964933 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 156/315] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:49:04 2022] GET /identity/v3/users/ae30f19084ad47069c943582b81f1201 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:04.970342 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72040ed1-1018-4b2f-9f9f-e7b36980a50a None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:05.087208 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72040ed1-1018-4b2f-9f9f-e7b36980a50a None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:05.122933 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cef8b-7b18-45f1-8266-6b2c1c86c995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:05.123538 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cef8b-7b18-45f1-8266-6b2c1c86c995 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:05.123816 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cef8b-7b18-45f1-8266-6b2c1c86c995 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:05.124119 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cef8b-7b18-45f1-8266-6b2c1c86c995 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:05.180804 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:05.195219 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76cef8b-7b18-45f1-8266-6b2c1c86c995 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:05.197048 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76cef8b-7b18-45f1-8266-6b2c1c86c995 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:05.300340 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 160/316] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:49:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:49:05.309426 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167040a-b0e0-410c-a089-76aa3bcfc68f None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:05.353866 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:05.418621 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167040a-b0e0-410c-a089-76aa3bcfc68f None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:05.453230 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681034b4-6809-4b52-a2e7-328d90e3b7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:05.453857 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681034b4-6809-4b52-a2e7-328d90e3b7d0 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:05.454131 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681034b4-6809-4b52-a2e7-328d90e3b7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:05.454490 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681034b4-6809-4b52-a2e7-328d90e3b7d0 None admin] PATH_INFO: `/v3/projects/266db3a9097e4be4adb44df90ab84a02` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:05.455614 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681034b4-6809-4b52-a2e7-328d90e3b7d0 None admin] RBAC: Authorizing `identity:get_project(project_id=266db3a9097e4be4adb44df90ab84a02)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:05.457087 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681034b4-6809-4b52-a2e7-328d90e3b7d0 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:05.459029 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 157/317] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:49:05 2022] GET /identity/v3/projects/266db3a9097e4be4adb44df90ab84a02 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:05.465044 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cef8b-7b18-45f1-8266-6b2c1c86c995 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:05.555065 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:05.571885 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cef8b-7b18-45f1-8266-6b2c1c86c995 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:05.607545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efec13d-0a3e-46d6-841b-79583b96a19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:05.608107 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efec13d-0a3e-46d6-841b-79583b96a19e None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:05.608382 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efec13d-0a3e-46d6-841b-79583b96a19e None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:05.608647 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efec13d-0a3e-46d6-841b-79583b96a19e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:05.609360 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efec13d-0a3e-46d6-841b-79583b96a19e None admin] RBAC: Adding query filter params (role.id=bc70cac1c1b444989feeffc53b52d9ae, scope.project.id=266db3a9097e4be4adb44df90ab84a02, user.id=ae30f19084ad47069c943582b81f1201) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:05.609715 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efec13d-0a3e-46d6-841b-79583b96a19e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:05.611206 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efec13d-0a3e-46d6-841b-79583b96a19e None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:05.617605 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 161/318] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 11:49:05 2022] GET /identity/v3/role_assignments?user.id=ae30f19084ad47069c943582b81f1201&scope.project.id=266db3a9097e4be4adb44df90ab84a02&role.id=bc70cac1c1b444989feeffc53b52d9ae => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:05.838939 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacd4cd-b3fb-4a49-a0f7-ef98aa1163f8 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:05.839975 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacd4cd-b3fb-4a49-a0f7-ef98aa1163f8 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:05.839975 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacd4cd-b3fb-4a49-a0f7-ef98aa1163f8 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:05.841607 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 158/319] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:05.846906 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43dfdb-f0fe-4342-aed0-232c31222ed8 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:05.847189 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43dfdb-f0fe-4342-aed0-232c31222ed8 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:05.847468 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43dfdb-f0fe-4342-aed0-232c31222ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:05.868433 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-db43dfdb-f0fe-4342-aed0-232c31222ed8 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:05.869537 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-db43dfdb-f0fe-4342-aed0-232c31222ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:05.943902 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 162/320] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:49:06.127745 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc662d-1c79-485a-8578-0d7c6d278bf4 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:06.128183 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc662d-1c79-485a-8578-0d7c6d278bf4 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:06.128362 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc662d-1c79-485a-8578-0d7c6d278bf4 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:06.129796 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 159/321] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:06.134683 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334e753-f51d-42bc-afaa-0e81c4a65f09 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:06.135145 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334e753-f51d-42bc-afaa-0e81c4a65f09 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:06.135227 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334e753-f51d-42bc-afaa-0e81c4a65f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:06.146453 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357baf27-4459-4b53-ad02-1b198ee2f0d8 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:06.146735 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357baf27-4459-4b53-ad02-1b198ee2f0d8 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:06.147008 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357baf27-4459-4b53-ad02-1b198ee2f0d8 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:06.148367 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 160/322] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 11:49:06.153851 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1855ca3-569a-4731-9aab-0e9d003efc84 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:06.154129 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1855ca3-569a-4731-9aab-0e9d003efc84 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:06.154400 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1855ca3-569a-4731-9aab-0e9d003efc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:06.154680 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-4334e753-f51d-42bc-afaa-0e81c4a65f09 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:06.155843 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-4334e753-f51d-42bc-afaa-0e81c4a65f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:06.174189 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-b1855ca3-569a-4731-9aab-0e9d003efc84 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:06.175357 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-b1855ca3-569a-4731-9aab-0e9d003efc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:06.224977 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 163/323] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:49:06.247626 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 161/324] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 11:49:06.262866 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334e753-f51d-42bc-afaa-0e81c4a65f09 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:06.274767 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:06.367924 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334e753-f51d-42bc-afaa-0e81c4a65f09 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:06.401402 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f2d9b-c54d-4db1-9287-7ccc6f8373e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:06.402516 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f2d9b-c54d-4db1-9287-7ccc6f8373e3 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:06.402787 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f2d9b-c54d-4db1-9287-7ccc6f8373e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:06.403052 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f2d9b-c54d-4db1-9287-7ccc6f8373e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:06.404191 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f2d9b-c54d-4db1-9287-7ccc6f8373e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:06.405647 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f2d9b-c54d-4db1-9287-7ccc6f8373e3 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:06.407355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 164/325] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:06.412847 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1855ca3-569a-4731-9aab-0e9d003efc84 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:06.456651 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:06.516569 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1855ca3-569a-4731-9aab-0e9d003efc84 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:06.549391 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f2d9b-c54d-4db1-9287-7ccc6f8373e3 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:06.549709 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d88854-0ec2-4e9c-96e3-76b770e8124b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:06.550325 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d88854-0ec2-4e9c-96e3-76b770e8124b None admin] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:06.550591 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d88854-0ec2-4e9c-96e3-76b770e8124b None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:06.550862 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d88854-0ec2-4e9c-96e3-76b770e8124b None admin] PATH_INFO: `/v3/groups` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:06.551493 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d88854-0ec2-4e9c-96e3-76b770e8124b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:06.552974 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d88854-0ec2-4e9c-96e3-76b770e8124b None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:06.571310 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 162/326] 10.222.0.27 () {60 vars in 1134 bytes} [Wed Sep 21 11:49:06 2022] POST /identity/v3/groups => generated 226 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 11:49:06.578239 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d88854-0ec2-4e9c-96e3-76b770e8124b None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:06.659167 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:06.686306 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f2d9b-c54d-4db1-9287-7ccc6f8373e3 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:06.696631 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:06.700997 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d88854-0ec2-4e9c-96e3-76b770e8124b None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:06.726267 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb048aef-1082-4803-ac4c-803febb6182c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:06.726908 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb048aef-1082-4803-ac4c-803febb6182c None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:06.727181 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb048aef-1082-4803-ac4c-803febb6182c None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:06.727443 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb048aef-1082-4803-ac4c-803febb6182c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:06.739504 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb048aef-1082-4803-ac4c-803febb6182c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:06.743793 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d2303-6a37-4e70-b073-97a005278e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:06.744576 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d2303-6a37-4e70-b073-97a005278e25 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:06.744850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d2303-6a37-4e70-b073-97a005278e25 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:06.745029 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-cb048aef-1082-4803-ac4c-803febb6182c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 11:49:06.745029 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:06.745029 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:06.745029 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:06.745029 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:06.745029 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:06.745029 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:06.745029 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:06.745029 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:06.745029 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:06.745029 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:06.745029 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:06.745029 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:06.745029 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:06.745029 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:06.745029 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:06.746439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:06.746439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:06.746439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:06.746439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:06.746439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:06.746439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:06.746439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:06.746439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:06.746439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:06.746439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:06.746439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:06.746439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:06.746439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:06.746439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:06.746439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:06.746439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:06.747309 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:06.747309 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:06.747309 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:06.747309 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:06.747309 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:06.747309 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:06.747309 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:06.747309 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:06.747309 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:06.747309 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:06.747309 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 11:49:06.747309 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:06.748691 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d2303-6a37-4e70-b073-97a005278e25 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:06.748771 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 165/327] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:49:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:06.752750 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb048aef-1082-4803-ac4c-803febb6182c None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:06.760935 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d2303-6a37-4e70-b073-97a005278e25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:06.766991 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-348d2303-6a37-4e70-b073-97a005278e25 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:49:06.766991 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:06.766991 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:06.766991 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:06.766991 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:06.766991 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:06.766991 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:06.766991 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:06.766991 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:06.766991 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:06.766991 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:06.766991 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:06.766991 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:06.766991 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:06.766991 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:06.766991 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:06.768042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:06.768042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:06.768042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:06.768042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:06.768042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:06.768042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:06.768042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:06.768042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:06.768042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:06.768042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:06.768042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:06.768042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:06.768042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:06.768042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:06.768042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:06.768042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:06.768850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:06.768850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:06.768850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:06.768850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:06.768850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:06.768850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:06.768850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:06.768850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:06.768850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:06.768850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:06.768850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:49:06.768850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:06.768850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 163/328] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:49:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 11:49:06.774634 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d2303-6a37-4e70-b073-97a005278e25 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:06.873931 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb048aef-1082-4803-ac4c-803febb6182c None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:06.903842 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d2303-6a37-4e70-b073-97a005278e25 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:06.917327 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9f79a-aa7e-472e-bafa-6d1d2f234cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:06.918025 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9f79a-aa7e-472e-bafa-6d1d2f234cb4 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:06.918511 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9f79a-aa7e-472e-bafa-6d1d2f234cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:06.918623 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9f79a-aa7e-472e-bafa-6d1d2f234cb4 None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:06.919275 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9f79a-aa7e-472e-bafa-6d1d2f234cb4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:06.919550 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9f79a-aa7e-472e-bafa-6d1d2f234cb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:06.922921 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9f79a-aa7e-472e-bafa-6d1d2f234cb4 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:06.926671 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:06.931365 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 166/329] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 11:49:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:49:06.937747 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9f79a-aa7e-472e-bafa-6d1d2f234cb4 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:06.949029 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563169c0-2fa9-49cf-b373-599edd2dd401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:06.949639 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563169c0-2fa9-49cf-b373-599edd2dd401 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:06.949914 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563169c0-2fa9-49cf-b373-599edd2dd401 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:06.950181 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563169c0-2fa9-49cf-b373-599edd2dd401 None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:06.950837 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563169c0-2fa9-49cf-b373-599edd2dd401 None admin] RBAC: Adding query filter params (name=member) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:06.951649 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563169c0-2fa9-49cf-b373-599edd2dd401 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:06.952653 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563169c0-2fa9-49cf-b373-599edd2dd401 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:06.962597 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 164/330] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 11:49:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:49:06.967842 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563169c0-2fa9-49cf-b373-599edd2dd401 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:07.002157 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:07.070256 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9f79a-aa7e-472e-bafa-6d1d2f234cb4 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:07.093038 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563169c0-2fa9-49cf-b373-599edd2dd401 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:07.110364 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b47496-7836-4577-9458-21dd7e655cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:07.111329 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b47496-7836-4577-9458-21dd7e655cea None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:07.111756 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b47496-7836-4577-9458-21dd7e655cea None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:07.112208 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b47496-7836-4577-9458-21dd7e655cea None admin] PATH_INFO: `/v3/users/143e425e57174364a3d50fb7f69b021e` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:07.114292 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b47496-7836-4577-9458-21dd7e655cea None admin] RBAC: Authorizing `identity:get_user(user_id=143e425e57174364a3d50fb7f69b021e)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:07.115904 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b47496-7836-4577-9458-21dd7e655cea None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:07.117802 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 167/331] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:49:06 2022] GET /identity/v3/users/143e425e57174364a3d50fb7f69b021e => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:49:07.124214 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b47496-7836-4577-9458-21dd7e655cea None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:07.133567 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15871844-cbbc-4080-bd39-036189feb1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:07.134326 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15871844-cbbc-4080-bd39-036189feb1c4 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:07.134605 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15871844-cbbc-4080-bd39-036189feb1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:07.134875 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15871844-cbbc-4080-bd39-036189feb1c4 None admin] PATH_INFO: `/v3/users/d953714cafdf46239e9d11d6b69ebcff` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:07.137113 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15871844-cbbc-4080-bd39-036189feb1c4 None admin] RBAC: Authorizing `identity:get_user(user_id=d953714cafdf46239e9d11d6b69ebcff)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:07.138559 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15871844-cbbc-4080-bd39-036189feb1c4 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:07.140372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 165/332] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:49:06 2022] GET /identity/v3/users/d953714cafdf46239e9d11d6b69ebcff => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:49:07.146339 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15871844-cbbc-4080-bd39-036189feb1c4 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:07.213223 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:07.257343 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:07.262648 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b47496-7836-4577-9458-21dd7e655cea None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:07.269923 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15871844-cbbc-4080-bd39-036189feb1c4 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:07.310415 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48016fd4-0079-429c-80fe-9964fc5812f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:07.311171 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48016fd4-0079-429c-80fe-9964fc5812f2 None admin] REQUEST_METHOD: `PUT` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:07.311450 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48016fd4-0079-429c-80fe-9964fc5812f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:07.311723 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48016fd4-0079-429c-80fe-9964fc5812f2 None admin] PATH_INFO: `/v3/system/users/143e425e57174364a3d50fb7f69b021e/roles/bc70cac1c1b444989feeffc53b52d9ae` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:07.313211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48016fd4-0079-429c-80fe-9964fc5812f2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=143e425e57174364a3d50fb7f69b021e, role_id=bc70cac1c1b444989feeffc53b52d9ae)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:07.313654 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59039e-0c09-4c77-9e19-bc5bcd4ffa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:07.314281 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59039e-0c09-4c77-9e19-bc5bcd4ffa55 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:07.314539 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59039e-0c09-4c77-9e19-bc5bcd4ffa55 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:07.314648 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48016fd4-0079-429c-80fe-9964fc5812f2 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:07.314815 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59039e-0c09-4c77-9e19-bc5bcd4ffa55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:07.315526 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad59039e-0c09-4c77-9e19-bc5bcd4ffa55 None admin] RBAC: Adding query filter params (role.id=165db5ccce0540569e708b81df7a5577, user.id=d953714cafdf46239e9d11d6b69ebcff, scope.system=all) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:07.315830 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad59039e-0c09-4c77-9e19-bc5bcd4ffa55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:07.317800 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad59039e-0c09-4c77-9e19-bc5bcd4ffa55 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:07.325842 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 168/333] 10.222.0.27 () {58 vars in 1334 bytes} [Wed Sep 21 11:49:07 2022] PUT /identity/v3/system/users/143e425e57174364a3d50fb7f69b021e/roles/bc70cac1c1b444989feeffc53b52d9ae => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 11:49:07.333445 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 166/334] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Sep 21 11:49:07 2022] GET /identity/v3/role_assignments?user.id=d953714cafdf46239e9d11d6b69ebcff&scope.system=all&role.id=165db5ccce0540569e708b81df7a5577 => generated 510 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:49:09.304974 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a757273-0ca6-4529-bc04-21c687d15d5f None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:09.306021 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a757273-0ca6-4529-bc04-21c687d15d5f None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:09.306514 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a757273-0ca6-4529-bc04-21c687d15d5f None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:09.308466 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 169/335] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:09.313620 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c81b1d-b9ed-4f43-baf8-c974ef1b659e None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:09.314654 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c81b1d-b9ed-4f43-baf8-c974ef1b659e None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:09.315134 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c81b1d-b9ed-4f43-baf8-c974ef1b659e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:09.334897 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-81c81b1d-b9ed-4f43-baf8-c974ef1b659e None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:09.336428 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-81c81b1d-b9ed-4f43-baf8-c974ef1b659e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:09.420166 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 167/336] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:49:09.982981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b8187-2802-4e5b-ac57-68b331939b93 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:09.983664 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b8187-2802-4e5b-ac57-68b331939b93 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:09.984207 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b8187-2802-4e5b-ac57-68b331939b93 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:09.986010 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 170/337] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:09.998160 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ea2f0-e8f9-424e-aa6d-90f4e0068a3e None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:09.998867 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ea2f0-e8f9-424e-aa6d-90f4e0068a3e None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:09.999523 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ea2f0-e8f9-424e-aa6d-90f4e0068a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:10.021654 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-ae3ea2f0-e8f9-424e-aa6d-90f4e0068a3e None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:10.023151 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-ae3ea2f0-e8f9-424e-aa6d-90f4e0068a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:10.080693 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b8187-2802-4e5b-ac57-68b331939b93 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:10.138698 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 168/338] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:49:10.280502 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b8187-2802-4e5b-ac57-68b331939b93 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:10.324098 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:10.331847 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effceab5-2cfb-42d8-8efb-c1cce9b1ecd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:10.332604 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effceab5-2cfb-42d8-8efb-c1cce9b1ecd2 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:10.332881 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effceab5-2cfb-42d8-8efb-c1cce9b1ecd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:10.333151 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effceab5-2cfb-42d8-8efb-c1cce9b1ecd2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:10.355326 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effceab5-2cfb-42d8-8efb-c1cce9b1ecd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:10.360205 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-effceab5-2cfb-42d8-8efb-c1cce9b1ecd2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:49:10.360205 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:10.360205 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:10.360205 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:10.360205 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:10.360205 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:10.360205 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:10.360205 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:10.360205 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:10.360205 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:10.360205 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:10.360205 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:10.360205 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:10.360205 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:10.360205 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:10.360205 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:10.361090 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:10.361090 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:10.361090 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:10.361090 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:10.361090 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:10.361090 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:10.361090 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:10.361090 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:10.361090 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:10.361090 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:10.361090 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:10.361090 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:10.361090 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:10.361090 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:10.361090 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:10.361090 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:10.362466 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:10.362466 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:10.362466 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:10.362466 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:10.362466 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:10.362466 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:10.362466 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:10.362466 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:10.362466 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:10.362466 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:10.362466 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:49:10.362466 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:10.362466 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 171/339] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:49:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:10.367152 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ea2f0-e8f9-424e-aa6d-90f4e0068a3e None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:10.402443 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:10.509416 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ea2f0-e8f9-424e-aa6d-90f4e0068a3e None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:10.548583 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e74ea-c406-4efe-a910-ff50849ef3b4 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:10.548859 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e74ea-c406-4efe-a910-ff50849ef3b4 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:10.549052 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e74ea-c406-4efe-a910-ff50849ef3b4 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:10.550619 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 172/340] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:10.555683 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0816bc6-9640-466e-9c0f-f8fe1eb4c6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:10.556175 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87acc7a-5a84-47f2-969d-d2504838572b None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:10.556454 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87acc7a-5a84-47f2-969d-d2504838572b None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:10.556725 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87acc7a-5a84-47f2-969d-d2504838572b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:10.557220 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0816bc6-9640-466e-9c0f-f8fe1eb4c6fe None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:10.557712 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0816bc6-9640-466e-9c0f-f8fe1eb4c6fe None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:10.558199 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0816bc6-9640-466e-9c0f-f8fe1eb4c6fe None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:10.559093 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0816bc6-9640-466e-9c0f-f8fe1eb4c6fe None admin] RBAC: Adding query filter params (name=member) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:10.559595 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0816bc6-9640-466e-9c0f-f8fe1eb4c6fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:10.561354 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0816bc6-9640-466e-9c0f-f8fe1eb4c6fe None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:10.574015 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 169/341] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 11:49:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:10.580204 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-e87acc7a-5a84-47f2-969d-d2504838572b None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:10.581535 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-e87acc7a-5a84-47f2-969d-d2504838572b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:10.587387 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0816bc6-9640-466e-9c0f-f8fe1eb4c6fe None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:10.701417 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 173/342] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 11:49:10.702712 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87acc7a-5a84-47f2-969d-d2504838572b None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:10.717562 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:10.758958 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0816bc6-9640-466e-9c0f-f8fe1eb4c6fe None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:10.798452 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b6e6f-a7c1-4ead-bf26-d2793e4fa1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:10.799113 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b6e6f-a7c1-4ead-bf26-d2793e4fa1ef None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:10.799335 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b6e6f-a7c1-4ead-bf26-d2793e4fa1ef None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:10.799609 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b6e6f-a7c1-4ead-bf26-d2793e4fa1ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:10.878503 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87acc7a-5a84-47f2-969d-d2504838572b None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:10.913891 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b6e6f-a7c1-4ead-bf26-d2793e4fa1ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:10.916454 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b6e6f-a7c1-4ead-bf26-d2793e4fa1ef None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:10.928081 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:10.950941 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb7a9e-4547-49d1-8e48-3bc481ca3833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:10.951579 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb7a9e-4547-49d1-8e48-3bc481ca3833 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:10.951896 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb7a9e-4547-49d1-8e48-3bc481ca3833 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:10.952198 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb7a9e-4547-49d1-8e48-3bc481ca3833 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:10.978566 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb7a9e-4547-49d1-8e48-3bc481ca3833 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:10.983755 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-80bb7a9e-4547-49d1-8e48-3bc481ca3833 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 11:49:10.983755 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:10.983755 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:10.983755 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:10.983755 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:10.983755 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:10.983755 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:10.983755 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:10.983755 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:10.983755 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:10.983755 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:10.983755 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:10.983755 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:10.983755 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:10.983755 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:10.983755 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:10.984659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:10.984659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:10.984659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:10.984659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:10.984659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:10.984659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:10.984659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:10.984659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:10.984659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:10.984659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:10.984659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:10.984659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:10.984659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:10.984659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:10.984659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:10.984659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:10.985465 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:10.985465 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:10.985465 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:10.985465 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:10.985465 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:10.985465 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:10.985465 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:10.985465 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:10.985465 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:10.985465 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:10.985465 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 11:49:10.985465 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:10.993259 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 174/343] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 11:49:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:10.999600 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61815a7-0b30-40af-8f1b-d98a77919fdd None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:11.002959 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61815a7-0b30-40af-8f1b-d98a77919fdd None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:11.003440 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61815a7-0b30-40af-8f1b-d98a77919fdd None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:11.005019 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 175/344] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:10 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:11.013169 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61815a7-0b30-40af-8f1b-d98a77919fdd None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:11.066925 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:11.126180 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 170/345] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:49:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:49:11.127807 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef92e51-8526-4db1-8425-0abf511e795a None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:11.128276 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef92e51-8526-4db1-8425-0abf511e795a None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:11.128696 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef92e51-8526-4db1-8425-0abf511e795a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:11.156281 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-4ef92e51-8526-4db1-8425-0abf511e795a None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:11.157728 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-4ef92e51-8526-4db1-8425-0abf511e795a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:11.185762 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61815a7-0b30-40af-8f1b-d98a77919fdd None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:11.242371 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4ebbc-1ae1-432d-ae7b-8d11b8ace07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:11.242371 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4ebbc-1ae1-432d-ae7b-8d11b8ace07e None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:11.242371 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4ebbc-1ae1-432d-ae7b-8d11b8ace07e None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:11.242371 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4ebbc-1ae1-432d-ae7b-8d11b8ace07e None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:11.242786 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4ebbc-1ae1-432d-ae7b-8d11b8ace07e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:11.242786 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4ebbc-1ae1-432d-ae7b-8d11b8ace07e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:11.243666 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4ebbc-1ae1-432d-ae7b-8d11b8ace07e None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:11.252810 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 171/346] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:49:11.254271 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef92e51-8526-4db1-8425-0abf511e795a None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:11.255689 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 176/347] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:49:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:11.256687 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4ebbc-1ae1-432d-ae7b-8d11b8ace07e None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:11.313524 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:11.382434 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4ebbc-1ae1-432d-ae7b-8d11b8ace07e None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:11.410930 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:11.416153 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef92e51-8526-4db1-8425-0abf511e795a None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:11.424643 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24fe3d-f798-4429-a5e1-bc2c50120889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:11.425324 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24fe3d-f798-4429-a5e1-bc2c50120889 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:11.425606 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24fe3d-f798-4429-a5e1-bc2c50120889 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:11.425875 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24fe3d-f798-4429-a5e1-bc2c50120889 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:11.438538 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24fe3d-f798-4429-a5e1-bc2c50120889 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:11.444727 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-ae24fe3d-f798-4429-a5e1-bc2c50120889 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:49:11.444727 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:11.444727 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:11.444727 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:11.444727 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:11.444727 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:11.444727 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:11.444727 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:11.444727 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:11.444727 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:11.444727 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:11.444727 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:11.444727 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:11.444727 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:11.444727 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:11.444727 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:11.445659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:11.445659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:11.445659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:11.445659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:11.445659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:11.445659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:11.445659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:11.445659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:11.445659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:11.445659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:11.445659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:11.445659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:11.445659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:11.445659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:11.445659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:11.445659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:11.446588 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:11.446588 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:11.446588 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:11.446588 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:11.446588 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:11.446588 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:11.446588 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:11.446588 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:11.446588 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:11.446588 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:11.446588 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:49:11.446588 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:11.446588 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 177/348] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:49:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:11.447262 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24fe3d-f798-4429-a5e1-bc2c50120889 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:11.516690 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8f19f-05f9-4778-b150-03f153a6ff5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:11.517744 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8f19f-05f9-4778-b150-03f153a6ff5c None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:11.518222 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8f19f-05f9-4778-b150-03f153a6ff5c None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:11.518700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8f19f-05f9-4778-b150-03f153a6ff5c None admin] PATH_INFO: `/v3/projects/9717263f7d4a452e9bf8dfa0907bda95` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:11.520103 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf8f19f-05f9-4778-b150-03f153a6ff5c None admin] RBAC: Authorizing `identity:get_project(project_id=9717263f7d4a452e9bf8dfa0907bda95)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:11.521760 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf8f19f-05f9-4778-b150-03f153a6ff5c None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:11.523673 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 172/349] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:49:11 2022] GET /identity/v3/projects/9717263f7d4a452e9bf8dfa0907bda95 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:11.524655 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8f19f-05f9-4778-b150-03f153a6ff5c None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:11.558765 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24fe3d-f798-4429-a5e1-bc2c50120889 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:11.561262 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:11.604169 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17e700-70a4-42bd-976b-e425e00017d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:11.605122 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17e700-70a4-42bd-976b-e425e00017d5 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:11.605842 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17e700-70a4-42bd-976b-e425e00017d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:11.606299 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17e700-70a4-42bd-976b-e425e00017d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:11.682167 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17e700-70a4-42bd-976b-e425e00017d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:11.683945 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17e700-70a4-42bd-976b-e425e00017d5 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:11.714243 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8f19f-05f9-4778-b150-03f153a6ff5c None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:11.779296 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848565f-4107-4fdb-987d-2766f8f7d8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:11.779923 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848565f-4107-4fdb-987d-2766f8f7d8f7 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:11.780229 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848565f-4107-4fdb-987d-2766f8f7d8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:11.780497 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848565f-4107-4fdb-987d-2766f8f7d8f7 None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:11.781335 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1848565f-4107-4fdb-987d-2766f8f7d8f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:11.781555 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1848565f-4107-4fdb-987d-2766f8f7d8f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:11.782936 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1848565f-4107-4fdb-987d-2766f8f7d8f7 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:11.801834 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 178/350] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:49:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:49:11.802393 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 173/351] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 11:49:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:11.803252 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17e700-70a4-42bd-976b-e425e00017d5 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:11.803872 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1451ed2-3fdb-4fb5-820f-52ff55232324 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:11.804156 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1451ed2-3fdb-4fb5-820f-52ff55232324 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:11.804424 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1451ed2-3fdb-4fb5-820f-52ff55232324 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:11.805619 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 174/352] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:11.810042 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:11.811509 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1451ed2-3fdb-4fb5-820f-52ff55232324 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:11.848563 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:11.917838 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17e700-70a4-42bd-976b-e425e00017d5 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:11.938486 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1451ed2-3fdb-4fb5-820f-52ff55232324 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:11.966086 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c961150-4a53-4008-b169-91fba4fe910f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:11.966735 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c961150-4a53-4008-b169-91fba4fe910f None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:11.967004 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c961150-4a53-4008-b169-91fba4fe910f None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:11.967270 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c961150-4a53-4008-b169-91fba4fe910f None admin] PATH_INFO: `/v3/groups/6f4f8385258445a7bb735241629126a1` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:11.974238 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c961150-4a53-4008-b169-91fba4fe910f None admin] RBAC: Authorizing `identity:get_group(group_id=6f4f8385258445a7bb735241629126a1)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:11.975780 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c961150-4a53-4008-b169-91fba4fe910f None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:11.977545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 179/353] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 21 11:49:11 2022] GET /identity/v3/groups/6f4f8385258445a7bb735241629126a1 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:11.978403 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c961150-4a53-4008-b169-91fba4fe910f None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:12.002193 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485d6a0-9d46-412e-bb7d-5480712f5c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:12.002850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485d6a0-9d46-412e-bb7d-5480712f5c09 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:12.003129 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485d6a0-9d46-412e-bb7d-5480712f5c09 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:12.003401 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485d6a0-9d46-412e-bb7d-5480712f5c09 None admin] PATH_INFO: `/v3/projects/9717263f7d4a452e9bf8dfa0907bda95` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:12.004612 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e485d6a0-9d46-412e-bb7d-5480712f5c09 None admin] RBAC: Authorizing `identity:get_project(project_id=9717263f7d4a452e9bf8dfa0907bda95)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:12.006134 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e485d6a0-9d46-412e-bb7d-5480712f5c09 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:12.009741 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 175/354] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:49:11 2022] GET /identity/v3/projects/9717263f7d4a452e9bf8dfa0907bda95 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:12.009741 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d2217-134c-4a94-b9ec-e86d7ab58bd2 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:12.009741 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d2217-134c-4a94-b9ec-e86d7ab58bd2 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:12.010053 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d2217-134c-4a94-b9ec-e86d7ab58bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:12.029533 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-a07d2217-134c-4a94-b9ec-e86d7ab58bd2 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:12.030742 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-a07d2217-134c-4a94-b9ec-e86d7ab58bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:12.063520 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:12.102273 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c961150-4a53-4008-b169-91fba4fe910f None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:12.118181 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 176/355] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:49:12.118911 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d2217-134c-4a94-b9ec-e86d7ab58bd2 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:12.146637 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2ca01-c5a0-44e5-9d79-101dddd310fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:12.147401 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2ca01-c5a0-44e5-9d79-101dddd310fe None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:12.147780 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2ca01-c5a0-44e5-9d79-101dddd310fe None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:12.148218 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2ca01-c5a0-44e5-9d79-101dddd310fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:12.159328 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:12.239807 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe2ca01-c5a0-44e5-9d79-101dddd310fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:12.241347 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe2ca01-c5a0-44e5-9d79-101dddd310fe None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:12.243952 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d2217-134c-4a94-b9ec-e86d7ab58bd2 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:12.283549 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d85bb-2575-4fb1-bd79-3ce52c5ed423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:12.284294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d85bb-2575-4fb1-bd79-3ce52c5ed423 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:12.284636 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d85bb-2575-4fb1-bd79-3ce52c5ed423 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:12.284971 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d85bb-2575-4fb1-bd79-3ce52c5ed423 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:12.296434 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d85bb-2575-4fb1-bd79-3ce52c5ed423 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:12.302886 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-d04d85bb-2575-4fb1-bd79-3ce52c5ed423 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 11:49:12.302886 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:12.302886 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:12.302886 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:12.302886 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:12.302886 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:12.302886 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:12.302886 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:12.302886 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:12.302886 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:12.302886 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:12.302886 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:12.302886 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:12.302886 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:12.302886 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:12.302886 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:12.303808 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:12.303808 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:12.303808 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:12.303808 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:12.303808 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:12.303808 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:12.303808 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:12.303808 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:12.303808 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:12.303808 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:12.303808 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:12.303808 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:12.303808 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:12.303808 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:12.303808 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:12.303808 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:12.304683 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:12.304683 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:12.304683 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:12.304683 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:12.304683 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:12.304683 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:12.304683 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:12.304683 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:12.304683 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:12.304683 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:12.304683 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 11:49:12.304683 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:12.307426 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 177/356] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:49:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:12.308319 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d85bb-2575-4fb1-bd79-3ce52c5ed423 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:12.325880 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:12.375623 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 180/357] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:49:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:49:12.376479 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2ca01-c5a0-44e5-9d79-101dddd310fe None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:12.419511 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:12.437490 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d85bb-2575-4fb1-bd79-3ce52c5ed423 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:12.480357 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6fe8d-36bd-4463-818f-a2105b145478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:12.481317 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6fe8d-36bd-4463-818f-a2105b145478 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:12.481794 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6fe8d-36bd-4463-818f-a2105b145478 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:12.482248 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6fe8d-36bd-4463-818f-a2105b145478 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:12.483160 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6fe8d-36bd-4463-818f-a2105b145478 None admin] RBAC: Adding query filter params (group.id=6f4f8385258445a7bb735241629126a1, role.id=165db5ccce0540569e708b81df7a5577, scope.project.id=9717263f7d4a452e9bf8dfa0907bda95) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:12.483570 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6fe8d-36bd-4463-818f-a2105b145478 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:12.485135 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6fe8d-36bd-4463-818f-a2105b145478 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:12.492888 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 178/358] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 21 11:49:12 2022] GET /identity/v3/role_assignments?group.id=6f4f8385258445a7bb735241629126a1&scope.project.id=9717263f7d4a452e9bf8dfa0907bda95&role.id=165db5ccce0540569e708b81df7a5577 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:12.493761 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6fe8d-36bd-4463-818f-a2105b145478 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:12.515546 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2ca01-c5a0-44e5-9d79-101dddd310fe None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:12.565412 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbc2ce-a8cf-40a2-b69c-00d9a1675800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:12.565834 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbc2ce-a8cf-40a2-b69c-00d9a1675800 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:12.566115 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbc2ce-a8cf-40a2-b69c-00d9a1675800 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:12.566386 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbc2ce-a8cf-40a2-b69c-00d9a1675800 None admin] PATH_INFO: `/v3/groups/6f4f8385258445a7bb735241629126a1` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:12.568512 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbc2ce-a8cf-40a2-b69c-00d9a1675800 None admin] RBAC: Authorizing `identity:get_group(group_id=6f4f8385258445a7bb735241629126a1)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:12.569994 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbc2ce-a8cf-40a2-b69c-00d9a1675800 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:12.571611 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 181/359] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 21 11:49:12 2022] GET /identity/v3/groups/6f4f8385258445a7bb735241629126a1 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:12.572408 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbc2ce-a8cf-40a2-b69c-00d9a1675800 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:12.628782 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:12.651322 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6fe8d-36bd-4463-818f-a2105b145478 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:12.689420 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3e603-1f08-43a0-9d54-0acd41b076e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:12.690164 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3e603-1f08-43a0-9d54-0acd41b076e5 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:12.690437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3e603-1f08-43a0-9d54-0acd41b076e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:12.690700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3e603-1f08-43a0-9d54-0acd41b076e5 None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:12.691367 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a3e603-1f08-43a0-9d54-0acd41b076e5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:12.691765 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a3e603-1f08-43a0-9d54-0acd41b076e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:12.694811 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a3e603-1f08-43a0-9d54-0acd41b076e5 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:12.707672 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 179/360] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 11:49:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:12.712804 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3e603-1f08-43a0-9d54-0acd41b076e5 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:12.717526 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbc2ce-a8cf-40a2-b69c-00d9a1675800 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:12.737106 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:12.761077 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a5e9e-5844-4b73-9d36-cc9ebbb8bbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:12.762204 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a5e9e-5844-4b73-9d36-cc9ebbb8bbed None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:12.762481 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a5e9e-5844-4b73-9d36-cc9ebbb8bbed None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:12.762752 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a5e9e-5844-4b73-9d36-cc9ebbb8bbed None admin] PATH_INFO: `/v3/projects/266db3a9097e4be4adb44df90ab84a02` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:12.763914 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a5e9e-5844-4b73-9d36-cc9ebbb8bbed None admin] RBAC: Authorizing `identity:get_project(project_id=266db3a9097e4be4adb44df90ab84a02)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:12.765430 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a5e9e-5844-4b73-9d36-cc9ebbb8bbed None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:12.767113 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 182/361] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:49:12 2022] GET /identity/v3/projects/266db3a9097e4be4adb44df90ab84a02 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:12.768281 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabb66c-d59a-4b23-aa33-0b551da8bed9 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:12.768642 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabb66c-d59a-4b23-aa33-0b551da8bed9 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:12.768837 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabb66c-d59a-4b23-aa33-0b551da8bed9 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:12.770332 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 183/362] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:12.771035 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecabb66c-d59a-4b23-aa33-0b551da8bed9 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:12.844352 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3e603-1f08-43a0-9d54-0acd41b076e5 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:12.892453 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfcf88-c68a-4507-a8b8-f256fd41bde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:12.893465 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfcf88-c68a-4507-a8b8-f256fd41bde9 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:12.893739 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfcf88-c68a-4507-a8b8-f256fd41bde9 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:12.894008 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfcf88-c68a-4507-a8b8-f256fd41bde9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:12.911287 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecabb66c-d59a-4b23-aa33-0b551da8bed9 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:12.913037 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bfcf88-c68a-4507-a8b8-f256fd41bde9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:12.913879 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:12.920090 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-66bfcf88-c68a-4507-a8b8-f256fd41bde9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 11:49:12.920090 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:12.920090 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:12.920090 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:12.920090 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:12.920090 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:12.920090 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:12.920090 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:12.920090 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:12.920090 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:12.920090 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:12.920090 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:12.920090 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:12.920090 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:12.920090 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:12.920090 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:12.921042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:12.921042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:12.921042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:12.921042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:12.921042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:12.921042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:12.921042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:12.921042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:12.921042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:12.921042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:12.921042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:12.921042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:12.921042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:12.921042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:12.921042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:12.921042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:12.921872 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:12.921872 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:12.921872 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:12.921872 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:12.921872 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:12.921872 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:12.921872 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:12.921872 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:12.921872 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:12.921872 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:12.921872 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 11:49:12.921872 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:12.921872 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 180/363] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 11:49:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:12.922548 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfcf88-c68a-4507-a8b8-f256fd41bde9 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:12.957587 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518ee45-2979-45f2-8446-c2663d14b244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:12.958842 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518ee45-2979-45f2-8446-c2663d14b244 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:12.959208 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518ee45-2979-45f2-8446-c2663d14b244 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:12.960252 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518ee45-2979-45f2-8446-c2663d14b244 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:12.960252 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518ee45-2979-45f2-8446-c2663d14b244 None admin] RBAC: Adding query filter params (group.id=6f4f8385258445a7bb735241629126a1, role.id=c163d39b46d24a27a76fb9026fec24ff, scope.project.id=9717263f7d4a452e9bf8dfa0907bda95) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:12.960630 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518ee45-2979-45f2-8446-c2663d14b244 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:12.962187 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518ee45-2979-45f2-8446-c2663d14b244 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:12.978950 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 184/364] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 21 11:49:12 2022] GET /identity/v3/role_assignments?group.id=6f4f8385258445a7bb735241629126a1&scope.project.id=9717263f7d4a452e9bf8dfa0907bda95&role.id=c163d39b46d24a27a76fb9026fec24ff => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:12.979798 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518ee45-2979-45f2-8446-c2663d14b244 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:13.039155 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:13.075515 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfcf88-c68a-4507-a8b8-f256fd41bde9 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:13.121200 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518ee45-2979-45f2-8446-c2663d14b244 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:13.121719 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae9d56-8d95-49a8-80e6-089c89774b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:13.122393 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae9d56-8d95-49a8-80e6-089c89774b79 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:13.122666 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae9d56-8d95-49a8-80e6-089c89774b79 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:13.122937 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae9d56-8d95-49a8-80e6-089c89774b79 None admin] PATH_INFO: `/v3/users/143e425e57174364a3d50fb7f69b021e` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:13.124315 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae9d56-8d95-49a8-80e6-089c89774b79 None admin] RBAC: Authorizing `identity:get_user(user_id=143e425e57174364a3d50fb7f69b021e)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:13.126074 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae9d56-8d95-49a8-80e6-089c89774b79 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:13.127926 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 181/365] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 11:49:12 2022] GET /identity/v3/users/143e425e57174364a3d50fb7f69b021e => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:13.128967 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7f1ce-3025-4719-a452-be1ad37002ee None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:13.129244 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7f1ce-3025-4719-a452-be1ad37002ee None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:13.129513 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7f1ce-3025-4719-a452-be1ad37002ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:13.150982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-c7f7f1ce-3025-4719-a452-be1ad37002ee None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:13.152552 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-c7f7f1ce-3025-4719-a452-be1ad37002ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:13.166790 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1b45a-e8ff-48a2-aebd-0c71279f4160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:13.168704 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1b45a-e8ff-48a2-aebd-0c71279f4160 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:13.169223 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1b45a-e8ff-48a2-aebd-0c71279f4160 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:13.169714 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1b45a-e8ff-48a2-aebd-0c71279f4160 None admin] PATH_INFO: `/v3/groups/6f4f8385258445a7bb735241629126a1` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:13.171321 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1b45a-e8ff-48a2-aebd-0c71279f4160 None admin] RBAC: Authorizing `identity:get_group(group_id=6f4f8385258445a7bb735241629126a1)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:13.173248 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1b45a-e8ff-48a2-aebd-0c71279f4160 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:13.175710 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 185/366] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 21 11:49:12 2022] GET /identity/v3/groups/6f4f8385258445a7bb735241629126a1 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:13.176863 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1b45a-e8ff-48a2-aebd-0c71279f4160 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:13.226463 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:13.251026 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 182/367] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:49:13.251885 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7f1ce-3025-4719-a452-be1ad37002ee None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:13.321976 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1b45a-e8ff-48a2-aebd-0c71279f4160 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:13.366950 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:13.379216 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03366d-c5c3-4f9b-85ee-077a98475ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:13.380199 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03366d-c5c3-4f9b-85ee-077a98475ec3 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:13.382949 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03366d-c5c3-4f9b-85ee-077a98475ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:13.383517 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03366d-c5c3-4f9b-85ee-077a98475ec3 None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:13.384441 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03366d-c5c3-4f9b-85ee-077a98475ec3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:13.384961 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03366d-c5c3-4f9b-85ee-077a98475ec3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:13.389453 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03366d-c5c3-4f9b-85ee-077a98475ec3 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:13.408489 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 186/368] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:49:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:13.409976 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03366d-c5c3-4f9b-85ee-077a98475ec3 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:13.430068 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7f1ce-3025-4719-a452-be1ad37002ee None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:13.506836 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40905f21-f142-4d6f-9967-36b42ab8ed02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:13.507454 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40905f21-f142-4d6f-9967-36b42ab8ed02 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:13.507730 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40905f21-f142-4d6f-9967-36b42ab8ed02 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:13.508015 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40905f21-f142-4d6f-9967-36b42ab8ed02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:13.508737 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40905f21-f142-4d6f-9967-36b42ab8ed02 None admin] RBAC: Adding query filter params (role.id=bc70cac1c1b444989feeffc53b52d9ae, user.id=143e425e57174364a3d50fb7f69b021e, scope.system=all) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:13.509144 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40905f21-f142-4d6f-9967-36b42ab8ed02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:13.510787 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40905f21-f142-4d6f-9967-36b42ab8ed02 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:13.539586 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 183/369] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Sep 21 11:49:13 2022] GET /identity/v3/role_assignments?user.id=143e425e57174364a3d50fb7f69b021e&scope.system=all&role.id=bc70cac1c1b444989feeffc53b52d9ae => generated 510 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:13.540790 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40905f21-f142-4d6f-9967-36b42ab8ed02 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:13.601740 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03366d-c5c3-4f9b-85ee-077a98475ec3 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:13.604332 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:13.663640 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95ccfe-4a28-4d7f-9b91-e4a185769622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:13.664299 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95ccfe-4a28-4d7f-9b91-e4a185769622 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:13.664854 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95ccfe-4a28-4d7f-9b91-e4a185769622 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:13.665129 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95ccfe-4a28-4d7f-9b91-e4a185769622 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:13.665853 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95ccfe-4a28-4d7f-9b91-e4a185769622 None admin] RBAC: Adding query filter params (group.id=6f4f8385258445a7bb735241629126a1, role.id=165db5ccce0540569e708b81df7a5577, scope.project.id=266db3a9097e4be4adb44df90ab84a02) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:13.666423 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95ccfe-4a28-4d7f-9b91-e4a185769622 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:13.669156 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95ccfe-4a28-4d7f-9b91-e4a185769622 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:13.677127 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 187/370] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 21 11:49:13 2022] GET /identity/v3/role_assignments?group.id=6f4f8385258445a7bb735241629126a1&scope.project.id=266db3a9097e4be4adb44df90ab84a02&role.id=165db5ccce0540569e708b81df7a5577 => generated 260 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:13.708957 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40905f21-f142-4d6f-9967-36b42ab8ed02 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:13.742108 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:13.742414 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95ccfe-4a28-4d7f-9b91-e4a185769622 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:13.751161 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3a604-02cf-4e1a-90ea-36b3d64b5c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:13.752097 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3a604-02cf-4e1a-90ea-36b3d64b5c81 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:13.752410 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3a604-02cf-4e1a-90ea-36b3d64b5c81 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:13.752683 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3a604-02cf-4e1a-90ea-36b3d64b5c81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:13.858442 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3a604-02cf-4e1a-90ea-36b3d64b5c81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:13.861755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3a604-02cf-4e1a-90ea-36b3d64b5c81 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:13.951237 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95ccfe-4a28-4d7f-9b91-e4a185769622 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:13.980840 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 184/371] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:49:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:49:13.986565 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3a604-02cf-4e1a-90ea-36b3d64b5c81 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:14.011972 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279df4f-4a98-4b7d-b8c4-60bb306f52f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:14.013116 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279df4f-4a98-4b7d-b8c4-60bb306f52f9 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:14.013613 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279df4f-4a98-4b7d-b8c4-60bb306f52f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:14.014825 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279df4f-4a98-4b7d-b8c4-60bb306f52f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:14.035011 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279df4f-4a98-4b7d-b8c4-60bb306f52f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:14.036338 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:14.045476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-0279df4f-4a98-4b7d-b8c4-60bb306f52f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:49:14.045476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:14.045476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:14.045476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:14.045476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:14.045476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:14.045476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:14.045476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:14.045476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:14.045476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:14.045476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:14.045476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:14.045476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:14.045476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:14.045476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:14.045476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:14.046500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:14.046500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:14.046500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:14.046500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:14.046500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:14.046500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:14.046500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:14.046500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:14.046500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:14.046500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:14.046500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:14.046500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:14.046500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:14.046500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:14.046500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:14.046500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:14.047293 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:14.047293 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:14.047293 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:14.047293 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:14.047293 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:14.047293 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:14.047293 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:14.047293 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:14.047293 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:14.047293 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:14.047293 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:49:14.047293 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:14.052005 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 188/372] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 11:49:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 11:49:14.059523 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279df4f-4a98-4b7d-b8c4-60bb306f52f9 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:14.113197 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:14.172353 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3a604-02cf-4e1a-90ea-36b3d64b5c81 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:14.240071 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b882da-8294-4afe-a242-d70b0622d577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:14.240741 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b882da-8294-4afe-a242-d70b0622d577 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:14.241016 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b882da-8294-4afe-a242-d70b0622d577 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:14.241269 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b882da-8294-4afe-a242-d70b0622d577 None admin] PATH_INFO: `/v3/projects/266db3a9097e4be4adb44df90ab84a02` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:14.242446 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b882da-8294-4afe-a242-d70b0622d577 None admin] RBAC: Authorizing `identity:get_project(project_id=266db3a9097e4be4adb44df90ab84a02)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:14.243928 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b882da-8294-4afe-a242-d70b0622d577 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:14.245138 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279df4f-4a98-4b7d-b8c4-60bb306f52f9 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:14.250205 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 185/373] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:49:13 2022] GET /identity/v3/projects/266db3a9097e4be4adb44df90ab84a02 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:49:14.255635 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b882da-8294-4afe-a242-d70b0622d577 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:14.289483 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49776884-4492-4f53-af45-155a9b2d1f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:14.290090 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49776884-4492-4f53-af45-155a9b2d1f7f None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:14.290360 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49776884-4492-4f53-af45-155a9b2d1f7f None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:14.290625 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49776884-4492-4f53-af45-155a9b2d1f7f None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:14.291282 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49776884-4492-4f53-af45-155a9b2d1f7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:14.291575 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49776884-4492-4f53-af45-155a9b2d1f7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:14.293793 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49776884-4492-4f53-af45-155a9b2d1f7f None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:14.309623 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 189/374] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:49:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:49:14.315183 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49776884-4492-4f53-af45-155a9b2d1f7f None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:14.448174 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b882da-8294-4afe-a242-d70b0622d577 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:14.452149 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49776884-4492-4f53-af45-155a9b2d1f7f None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:14.452390 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:14.456337 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:14.499227 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc7816-67e5-491c-adb4-f971df44b703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:14.499885 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc7816-67e5-491c-adb4-f971df44b703 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:14.500185 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc7816-67e5-491c-adb4-f971df44b703 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:14.500451 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc7816-67e5-491c-adb4-f971df44b703 None admin] PATH_INFO: `/v3/groups/6f4f8385258445a7bb735241629126a1` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:14.501645 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc7816-67e5-491c-adb4-f971df44b703 None admin] RBAC: Authorizing `identity:get_group(group_id=6f4f8385258445a7bb735241629126a1)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:14.503073 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc7816-67e5-491c-adb4-f971df44b703 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:14.505255 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 186/375] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 21 11:49:14 2022] GET /identity/v3/groups/6f4f8385258445a7bb735241629126a1 => generated 226 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:49:14.511262 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc7816-67e5-491c-adb4-f971df44b703 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:14.511716 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94a0a3-2c6d-445f-8122-c4138ab37efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:14.512360 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94a0a3-2c6d-445f-8122-c4138ab37efa None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:14.512634 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94a0a3-2c6d-445f-8122-c4138ab37efa None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:14.512904 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94a0a3-2c6d-445f-8122-c4138ab37efa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:14.622137 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc7816-67e5-491c-adb4-f971df44b703 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:14.639544 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94a0a3-2c6d-445f-8122-c4138ab37efa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:14.641687 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94a0a3-2c6d-445f-8122-c4138ab37efa None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:14.662702 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2168390-3dba-4b05-9196-4f43d50245d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:14.662702 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2168390-3dba-4b05-9196-4f43d50245d2 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:14.662702 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2168390-3dba-4b05-9196-4f43d50245d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:14.662702 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2168390-3dba-4b05-9196-4f43d50245d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:14.663114 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2168390-3dba-4b05-9196-4f43d50245d2 None admin] RBAC: Adding query filter params (group.id=6f4f8385258445a7bb735241629126a1, role.id=c163d39b46d24a27a76fb9026fec24ff, scope.project.id=266db3a9097e4be4adb44df90ab84a02) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:14.663114 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2168390-3dba-4b05-9196-4f43d50245d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:14.663114 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2168390-3dba-4b05-9196-4f43d50245d2 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:14.672057 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 187/376] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 21 11:49:14 2022] GET /identity/v3/role_assignments?group.id=6f4f8385258445a7bb735241629126a1&scope.project.id=266db3a9097e4be4adb44df90ab84a02&role.id=c163d39b46d24a27a76fb9026fec24ff => generated 260 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:49:14.759805 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:14.778740 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 190/377] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:49:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:49:14.784871 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2168390-3dba-4b05-9196-4f43d50245d2 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:14.834376 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:14.930986 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2168390-3dba-4b05-9196-4f43d50245d2 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:14.977653 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00509eed-90f4-4ec2-9df5-fe3a081dd6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:14.978286 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00509eed-90f4-4ec2-9df5-fe3a081dd6e3 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:14.978560 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00509eed-90f4-4ec2-9df5-fe3a081dd6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:14.978835 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00509eed-90f4-4ec2-9df5-fe3a081dd6e3 None admin] PATH_INFO: `/v3/projects/e314d339abaf4ce28ec0c1d1e6483dff` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:14.981472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00509eed-90f4-4ec2-9df5-fe3a081dd6e3 None admin] RBAC: Authorizing `identity:get_project(project_id=e314d339abaf4ce28ec0c1d1e6483dff)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:14.983136 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00509eed-90f4-4ec2-9df5-fe3a081dd6e3 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:14.985340 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 188/378] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:49:14 2022] GET /identity/v3/projects/e314d339abaf4ce28ec0c1d1e6483dff => generated 344 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:14.991397 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94a0a3-2c6d-445f-8122-c4138ab37efa None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:15.125852 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94a0a3-2c6d-445f-8122-c4138ab37efa None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:15.170772 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1bdbae-828c-4e95-8ff8-3e8daaa8caa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:15.171631 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1bdbae-828c-4e95-8ff8-3e8daaa8caa6 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:15.172065 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1bdbae-828c-4e95-8ff8-3e8daaa8caa6 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:15.172490 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1bdbae-828c-4e95-8ff8-3e8daaa8caa6 None admin] PATH_INFO: `/v3/groups/f0522bc6d2ec45e8b2c1ff6a01f1e9d3` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:15.180734 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1bdbae-828c-4e95-8ff8-3e8daaa8caa6 None admin] RBAC: Authorizing `identity:get_group(group_id=f0522bc6d2ec45e8b2c1ff6a01f1e9d3)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:15.182351 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1bdbae-828c-4e95-8ff8-3e8daaa8caa6 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:15.184208 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 191/379] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 21 11:49:14 2022] GET /identity/v3/groups/f0522bc6d2ec45e8b2c1ff6a01f1e9d3 => generated 229 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:15.190079 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00509eed-90f4-4ec2-9df5-fe3a081dd6e3 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:15.314525 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:15.319688 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00509eed-90f4-4ec2-9df5-fe3a081dd6e3 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:15.361517 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c525940-5d1e-4fc9-887a-73a751c69665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:15.362167 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c525940-5d1e-4fc9-887a-73a751c69665 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:15.362478 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c525940-5d1e-4fc9-887a-73a751c69665 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:15.362748 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c525940-5d1e-4fc9-887a-73a751c69665 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:15.363479 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c525940-5d1e-4fc9-887a-73a751c69665 None admin] RBAC: Adding query filter params (group.id=f0522bc6d2ec45e8b2c1ff6a01f1e9d3, role.id=d1f3d1431da145709a5e9b374f3b403d, scope.project.id=e314d339abaf4ce28ec0c1d1e6483dff) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:15.363781 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c525940-5d1e-4fc9-887a-73a751c69665 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:15.365294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c525940-5d1e-4fc9-887a-73a751c69665 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:15.371906 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 189/380] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 21 11:49:15 2022] GET /identity/v3/role_assignments?group.id=f0522bc6d2ec45e8b2c1ff6a01f1e9d3&scope.project.id=e314d339abaf4ce28ec0c1d1e6483dff&role.id=d1f3d1431da145709a5e9b374f3b403d => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:15.802922 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34305f43-7242-4d14-8597-890c2a59d08a None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:15.803908 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34305f43-7242-4d14-8597-890c2a59d08a None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:15.804500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34305f43-7242-4d14-8597-890c2a59d08a None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:15.806024 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 192/381] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:15.812247 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfb794-bbb7-402d-a6ac-c75864d5320a None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:15.812705 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfb794-bbb7-402d-a6ac-c75864d5320a None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:15.812781 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfb794-bbb7-402d-a6ac-c75864d5320a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:15.832823 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-92bfb794-bbb7-402d-a6ac-c75864d5320a None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:15.833987 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-92bfb794-bbb7-402d-a6ac-c75864d5320a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:15.904192 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 190/382] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 11:49:16.160407 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da381f62-b849-4798-a477-61f1f36e71db None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:16.160992 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da381f62-b849-4798-a477-61f1f36e71db None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:16.161455 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da381f62-b849-4798-a477-61f1f36e71db None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:16.163222 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 193/383] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:16.169541 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723f559-274b-4180-bce1-ae8715b4f5c8 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:16.170099 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723f559-274b-4180-bce1-ae8715b4f5c8 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:16.170599 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723f559-274b-4180-bce1-ae8715b4f5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:16.193868 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-4723f559-274b-4180-bce1-ae8715b4f5c8 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:16.195030 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-4723f559-274b-4180-bce1-ae8715b4f5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:16.277492 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 191/384] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 11:49:16.349669 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da381f62-b849-4798-a477-61f1f36e71db None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:16.416754 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:16.487731 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da381f62-b849-4798-a477-61f1f36e71db None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:16.537614 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d857d7-2a7c-4287-8cea-9628d7b16d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:16.538245 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d857d7-2a7c-4287-8cea-9628d7b16d55 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:16.538515 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d857d7-2a7c-4287-8cea-9628d7b16d55 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:16.538775 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d857d7-2a7c-4287-8cea-9628d7b16d55 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:16.554321 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d857d7-2a7c-4287-8cea-9628d7b16d55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:16.559119 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-18d857d7-2a7c-4287-8cea-9628d7b16d55 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:49:16.559119 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:16.559119 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:16.559119 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:16.559119 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:16.559119 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:16.559119 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:16.559119 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:16.559119 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:16.559119 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:16.559119 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:16.559119 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:16.559119 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:16.559119 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:16.559119 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:16.559119 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:16.560038 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:16.560038 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:16.560038 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:16.560038 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:16.560038 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:16.560038 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:16.560038 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:16.560038 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:16.560038 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:16.560038 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:16.560038 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:16.560038 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:16.560038 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:16.560038 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:16.560038 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:16.560038 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:16.560856 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:16.560856 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:16.560856 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:16.560856 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:16.560856 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:16.560856 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:16.560856 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:16.560856 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:16.560856 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:16.560856 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:16.560856 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:49:16.560856 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:16.560856 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 194/385] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:49:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:16.568132 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723f559-274b-4180-bce1-ae8715b4f5c8 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:16.616023 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:16.707803 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723f559-274b-4180-bce1-ae8715b4f5c8 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:16.752215 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270ef97-c68c-4b2c-b36d-dcddf99202c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:16.752833 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270ef97-c68c-4b2c-b36d-dcddf99202c8 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:16.753111 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270ef97-c68c-4b2c-b36d-dcddf99202c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:16.753383 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270ef97-c68c-4b2c-b36d-dcddf99202c8 None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:16.754047 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270ef97-c68c-4b2c-b36d-dcddf99202c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:16.754349 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270ef97-c68c-4b2c-b36d-dcddf99202c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:16.755717 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270ef97-c68c-4b2c-b36d-dcddf99202c8 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:16.765200 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 192/386] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 11:49:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:16.773060 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d857d7-2a7c-4287-8cea-9628d7b16d55 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:16.822491 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270ef97-c68c-4b2c-b36d-dcddf99202c8 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:16.954923 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d857d7-2a7c-4287-8cea-9628d7b16d55 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:16.965355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:16.971831 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:17.001562 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270ef97-c68c-4b2c-b36d-dcddf99202c8 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:17.011906 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d282a37-2205-479e-8d26-9bcb5b592a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:17.013114 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d282a37-2205-479e-8d26-9bcb5b592a1b None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:17.013463 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d282a37-2205-479e-8d26-9bcb5b592a1b None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:17.013802 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d282a37-2205-479e-8d26-9bcb5b592a1b None admin] PATH_INFO: `/v3/groups/6f4f8385258445a7bb735241629126a1` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:17.015570 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d282a37-2205-479e-8d26-9bcb5b592a1b None admin] RBAC: Authorizing `identity:get_group(group_id=6f4f8385258445a7bb735241629126a1)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:17.017420 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d282a37-2205-479e-8d26-9bcb5b592a1b None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:17.019346 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 195/387] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 21 11:49:16 2022] GET /identity/v3/groups/6f4f8385258445a7bb735241629126a1 => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:17.024919 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d282a37-2205-479e-8d26-9bcb5b592a1b None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:17.046538 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a776c7-5728-46a5-8ac0-6a69a5a04d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:17.047531 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a776c7-5728-46a5-8ac0-6a69a5a04d6b None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:17.048090 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a776c7-5728-46a5-8ac0-6a69a5a04d6b None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:17.048561 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a776c7-5728-46a5-8ac0-6a69a5a04d6b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:17.061104 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a776c7-5728-46a5-8ac0-6a69a5a04d6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:17.067136 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-f8a776c7-5728-46a5-8ac0-6a69a5a04d6b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 11:49:17.067136 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:17.067136 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:17.067136 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:17.067136 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:17.067136 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:17.067136 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:17.067136 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:17.067136 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:17.067136 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:17.067136 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:17.067136 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:17.067136 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:17.067136 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:17.067136 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:17.067136 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:17.068066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:17.068066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:17.068066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:17.068066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:17.068066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:17.068066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:17.068066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:17.068066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:17.068066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:17.068066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:17.068066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:17.068066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:17.068066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:17.068066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:17.068066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:17.068066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:17.068913 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:17.068913 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:17.068913 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:17.068913 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:17.068913 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:17.068913 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:17.068913 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:17.068913 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:17.068913 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:17.068913 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:17.068913 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 11:49:17.068913 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:17.071415 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 193/388] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 11:49:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 11:49:17.077498 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a776c7-5728-46a5-8ac0-6a69a5a04d6b None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:17.189655 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a776c7-5728-46a5-8ac0-6a69a5a04d6b None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:17.196557 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d282a37-2205-479e-8d26-9bcb5b592a1b None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:17.225835 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac0758-2810-4ae6-a10f-64c9d02ab9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:17.226776 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac0758-2810-4ae6-a10f-64c9d02ab9e6 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:17.227291 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac0758-2810-4ae6-a10f-64c9d02ab9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:17.227799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac0758-2810-4ae6-a10f-64c9d02ab9e6 None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:17.228742 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac0758-2810-4ae6-a10f-64c9d02ab9e6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:17.229113 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac0758-2810-4ae6-a10f-64c9d02ab9e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:17.231236 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac0758-2810-4ae6-a10f-64c9d02ab9e6 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:17.237218 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9db89c-ffba-4cf3-bcea-1b201a4cbff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:17.238135 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9db89c-ffba-4cf3-bcea-1b201a4cbff4 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:17.238628 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9db89c-ffba-4cf3-bcea-1b201a4cbff4 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:17.239088 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9db89c-ffba-4cf3-bcea-1b201a4cbff4 None admin] PATH_INFO: `/v3/projects/9717263f7d4a452e9bf8dfa0907bda95` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:17.241023 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 194/389] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:49:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:49:17.241459 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9db89c-ffba-4cf3-bcea-1b201a4cbff4 None admin] RBAC: Authorizing `identity:get_project(project_id=9717263f7d4a452e9bf8dfa0907bda95)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:17.242324 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48887b8a-72a1-440e-ad09-ec6bbd9dc93d None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:17.242611 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48887b8a-72a1-440e-ad09-ec6bbd9dc93d None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:17.242886 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48887b8a-72a1-440e-ad09-ec6bbd9dc93d None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:17.243733 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9db89c-ffba-4cf3-bcea-1b201a4cbff4 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:17.245873 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 196/390] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:49:17 2022] GET /identity/v3/projects/9717263f7d4a452e9bf8dfa0907bda95 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:17.248791 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 195/391] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:17.249058 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9db89c-ffba-4cf3-bcea-1b201a4cbff4 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:17.254491 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fe02e-8d4c-425d-b1c8-8755f6e76d04 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:17.254774 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fe02e-8d4c-425d-b1c8-8755f6e76d04 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:17.255048 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fe02e-8d4c-425d-b1c8-8755f6e76d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:17.275617 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:17.285476 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-410fe02e-8d4c-425d-b1c8-8755f6e76d04 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:17.286938 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-410fe02e-8d4c-425d-b1c8-8755f6e76d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:17.313680 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:17.359563 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 196/392] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:49:17.360491 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fe02e-8d4c-425d-b1c8-8755f6e76d04 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:17.400541 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9db89c-ffba-4cf3-bcea-1b201a4cbff4 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:17.472241 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448be551-3f16-4f89-bbe2-acc4dd7acd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:17.472877 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448be551-3f16-4f89-bbe2-acc4dd7acd53 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:17.473153 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448be551-3f16-4f89-bbe2-acc4dd7acd53 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:17.473421 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448be551-3f16-4f89-bbe2-acc4dd7acd53 None admin] PATH_INFO: `/v3/groups/6f4f8385258445a7bb735241629126a1` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:17.478282 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448be551-3f16-4f89-bbe2-acc4dd7acd53 None admin] RBAC: Authorizing `identity:get_group(group_id=6f4f8385258445a7bb735241629126a1)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:17.479264 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448be551-3f16-4f89-bbe2-acc4dd7acd53 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:17.481748 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 197/393] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 21 11:49:17 2022] GET /identity/v3/groups/6f4f8385258445a7bb735241629126a1 => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:17.488854 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448be551-3f16-4f89-bbe2-acc4dd7acd53 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:17.537667 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fe02e-8d4c-425d-b1c8-8755f6e76d04 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:17.576726 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aac966-0634-48d3-be76-76cbd33dcacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:17.577400 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aac966-0634-48d3-be76-76cbd33dcacb None admin] REQUEST_METHOD: `PUT` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:17.577678 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aac966-0634-48d3-be76-76cbd33dcacb None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:17.577949 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aac966-0634-48d3-be76-76cbd33dcacb None admin] PATH_INFO: `/v3/projects/9717263f7d4a452e9bf8dfa0907bda95/groups/6f4f8385258445a7bb735241629126a1/roles/165db5ccce0540569e708b81df7a5577` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:17.579882 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aac966-0634-48d3-be76-76cbd33dcacb None admin] RBAC: Authorizing `identity:create_grant(project_id=9717263f7d4a452e9bf8dfa0907bda95, group_id=6f4f8385258445a7bb735241629126a1, role_id=165db5ccce0540569e708b81df7a5577)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:17.581351 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aac966-0634-48d3-be76-76cbd33dcacb None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:17.584866 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:17.596293 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 197/394] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Sep 21 11:49:17 2022] PUT /identity/v3/projects/9717263f7d4a452e9bf8dfa0907bda95/groups/6f4f8385258445a7bb735241629126a1/roles/165db5ccce0540569e708b81df7a5577 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 11:49:17.663180 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448be551-3f16-4f89-bbe2-acc4dd7acd53 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:17.678193 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:17.711758 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56842bfa-f1fa-4a5b-adf6-c256085e3c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:17.712436 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56842bfa-f1fa-4a5b-adf6-c256085e3c22 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:17.712709 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56842bfa-f1fa-4a5b-adf6-c256085e3c22 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:17.712976 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56842bfa-f1fa-4a5b-adf6-c256085e3c22 None admin] PATH_INFO: `/v3/projects/9717263f7d4a452e9bf8dfa0907bda95` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:17.714179 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56842bfa-f1fa-4a5b-adf6-c256085e3c22 None admin] RBAC: Authorizing `identity:get_project(project_id=9717263f7d4a452e9bf8dfa0907bda95)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:17.716679 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56842bfa-f1fa-4a5b-adf6-c256085e3c22 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:17.718350 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 198/395] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:49:17 2022] GET /identity/v3/projects/9717263f7d4a452e9bf8dfa0907bda95 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:17.724370 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aac966-0634-48d3-be76-76cbd33dcacb None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:17.824470 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb44d05-145e-4dc4-94df-cd8d03d610b6 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:17.824649 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb44d05-145e-4dc4-94df-cd8d03d610b6 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:17.824920 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb44d05-145e-4dc4-94df-cd8d03d610b6 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:17.826313 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 199/396] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:17.832250 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400b521-43e2-4e9c-a761-93bbb2c97a1a None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:17.832534 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400b521-43e2-4e9c-a761-93bbb2c97a1a None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:17.832790 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400b521-43e2-4e9c-a761-93bbb2c97a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:17.856938 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-2400b521-43e2-4e9c-a761-93bbb2c97a1a None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:17.858163 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-2400b521-43e2-4e9c-a761-93bbb2c97a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:17.895771 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aac966-0634-48d3-be76-76cbd33dcacb None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:17.936600 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ef9df-7486-4ce9-b7db-3f704ac7535b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:17.937519 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ef9df-7486-4ce9-b7db-3f704ac7535b None admin] REQUEST_METHOD: `PUT` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:17.937788 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ef9df-7486-4ce9-b7db-3f704ac7535b None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:17.938491 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ef9df-7486-4ce9-b7db-3f704ac7535b None admin] PATH_INFO: `/v3/projects/9717263f7d4a452e9bf8dfa0907bda95/groups/6f4f8385258445a7bb735241629126a1/roles/c163d39b46d24a27a76fb9026fec24ff` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:17.941465 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ef9df-7486-4ce9-b7db-3f704ac7535b None admin] RBAC: Authorizing `identity:create_grant(project_id=9717263f7d4a452e9bf8dfa0907bda95, group_id=6f4f8385258445a7bb735241629126a1, role_id=c163d39b46d24a27a76fb9026fec24ff)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:17.943158 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ef9df-7486-4ce9-b7db-3f704ac7535b None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:17.950497 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 200/397] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 11:49:17.951401 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400b521-43e2-4e9c-a761-93bbb2c97a1a None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:17.967777 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 198/398] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Sep 21 11:49:17 2022] PUT /identity/v3/projects/9717263f7d4a452e9bf8dfa0907bda95/groups/6f4f8385258445a7bb735241629126a1/roles/c163d39b46d24a27a76fb9026fec24ff => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 11:49:18.088696 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400b521-43e2-4e9c-a761-93bbb2c97a1a None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:18.107063 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:18.150613 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0523f14-5834-4b0c-8720-171fd5faef58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:18.151247 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0523f14-5834-4b0c-8720-171fd5faef58 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:18.151517 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0523f14-5834-4b0c-8720-171fd5faef58 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:18.151842 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0523f14-5834-4b0c-8720-171fd5faef58 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:18.168989 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0523f14-5834-4b0c-8720-171fd5faef58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:18.174161 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-e0523f14-5834-4b0c-8720-171fd5faef58 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:49:18.174161 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:18.174161 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:18.174161 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:18.174161 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:18.174161 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:18.174161 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:18.174161 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:18.174161 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:18.174161 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:18.174161 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:18.174161 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:18.174161 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:18.174161 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:18.174161 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:18.174161 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:18.175057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:18.175057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:18.175057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:18.175057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:18.175057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:18.175057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:18.175057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:18.175057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:18.175057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:18.175057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:18.175057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:18.175057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:18.175057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:18.175057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:18.175057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:18.175057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:18.175864 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:18.175864 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:18.175864 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:18.175864 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:18.175864 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:18.175864 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:18.175864 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:18.175864 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:18.175864 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:18.175864 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:18.175864 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:49:18.175864 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:18.175864 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 201/399] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:49:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:18.182861 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ef9df-7486-4ce9-b7db-3f704ac7535b None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:18.284120 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:18.349545 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ef9df-7486-4ce9-b7db-3f704ac7535b None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:18.354238 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0523f14-5834-4b0c-8720-171fd5faef58 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:18.416814 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b1a9f-4e23-43a0-9661-641f061ad6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:18.417743 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b1a9f-4e23-43a0-9661-641f061ad6af None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:18.418020 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b1a9f-4e23-43a0-9661-641f061ad6af None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:18.418289 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b1a9f-4e23-43a0-9661-641f061ad6af None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:18.418967 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b1a9f-4e23-43a0-9661-641f061ad6af None admin] RBAC: Adding query filter params (name=member) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:18.419267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b1a9f-4e23-43a0-9661-641f061ad6af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:18.420678 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b1a9f-4e23-43a0-9661-641f061ad6af None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:18.435795 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 199/400] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 11:49:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:18.441060 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b1a9f-4e23-43a0-9661-641f061ad6af None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:18.462902 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0523f14-5834-4b0c-8720-171fd5faef58 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:18.503572 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768d79a-cbf7-4d65-a4fa-a885d2c1576b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:18.504325 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768d79a-cbf7-4d65-a4fa-a885d2c1576b None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:18.504662 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768d79a-cbf7-4d65-a4fa-a885d2c1576b None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:18.504997 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768d79a-cbf7-4d65-a4fa-a885d2c1576b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:18.519272 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b768d79a-cbf7-4d65-a4fa-a885d2c1576b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:18.525294 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-b768d79a-cbf7-4d65-a4fa-a885d2c1576b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 11:49:18.525294 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:18.525294 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:18.525294 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:18.525294 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:18.525294 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:18.525294 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:18.525294 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:18.525294 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:18.525294 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:18.525294 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:18.525294 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:18.525294 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:18.525294 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:18.525294 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:18.525294 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:18.526226 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:18.526226 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:18.526226 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:18.526226 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:18.526226 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:18.526226 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:18.526226 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:18.526226 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:18.526226 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:18.526226 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:18.526226 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:18.526226 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:18.526226 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:18.526226 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:18.526226 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:18.526226 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:18.527053 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:18.527053 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:18.527053 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:18.527053 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:18.527053 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:18.527053 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:18.527053 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:18.527053 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:18.527053 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:18.527053 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:18.527053 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 11:49:18.527053 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:18.528134 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 202/401] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 11:49:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 11:49:18.534120 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768d79a-cbf7-4d65-a4fa-a885d2c1576b None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:18.573114 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b1a9f-4e23-43a0-9661-641f061ad6af None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:18.592224 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:18.615598 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:18.652595 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051385b3-a775-46b2-931a-f8b3485b0c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:18.653588 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051385b3-a775-46b2-931a-f8b3485b0c37 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:18.654075 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051385b3-a775-46b2-931a-f8b3485b0c37 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:18.654650 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051385b3-a775-46b2-931a-f8b3485b0c37 None admin] PATH_INFO: `/v3/groups/6f4f8385258445a7bb735241629126a1` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:18.660938 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051385b3-a775-46b2-931a-f8b3485b0c37 None admin] RBAC: Authorizing `identity:get_group(group_id=6f4f8385258445a7bb735241629126a1)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:18.662730 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051385b3-a775-46b2-931a-f8b3485b0c37 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:18.664773 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 200/402] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 21 11:49:18 2022] GET /identity/v3/groups/6f4f8385258445a7bb735241629126a1 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:49:18.670796 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051385b3-a775-46b2-931a-f8b3485b0c37 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:18.689428 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768d79a-cbf7-4d65-a4fa-a885d2c1576b None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:18.751849 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be63e077-e484-47b3-b021-5ecb973dcf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:18.752823 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63e077-e484-47b3-b021-5ecb973dcf60 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:18.753331 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63e077-e484-47b3-b021-5ecb973dcf60 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:18.753786 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63e077-e484-47b3-b021-5ecb973dcf60 None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:18.754640 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be63e077-e484-47b3-b021-5ecb973dcf60 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:18.755130 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be63e077-e484-47b3-b021-5ecb973dcf60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:18.756746 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be63e077-e484-47b3-b021-5ecb973dcf60 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:18.769804 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 203/403] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:49:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:18.777033 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be63e077-e484-47b3-b021-5ecb973dcf60 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:18.852923 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051385b3-a775-46b2-931a-f8b3485b0c37 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:18.903141 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe93d3-5b53-46f7-b993-86ec203c8496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:18.903788 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe93d3-5b53-46f7-b993-86ec203c8496 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:18.904192 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe93d3-5b53-46f7-b993-86ec203c8496 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:18.904482 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe93d3-5b53-46f7-b993-86ec203c8496 None admin] PATH_INFO: `/v3/projects/266db3a9097e4be4adb44df90ab84a02` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:18.905722 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe93d3-5b53-46f7-b993-86ec203c8496 None admin] RBAC: Authorizing `identity:get_project(project_id=266db3a9097e4be4adb44df90ab84a02)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:18.907235 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe93d3-5b53-46f7-b993-86ec203c8496 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:18.909273 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 201/404] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:49:18 2022] GET /identity/v3/projects/266db3a9097e4be4adb44df90ab84a02 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:18.910461 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d3000-5de0-4adb-a730-ce356d58a1a8 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:18.910742 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d3000-5de0-4adb-a730-ce356d58a1a8 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:18.911010 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d3000-5de0-4adb-a730-ce356d58a1a8 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:18.912375 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 202/405] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:18.918408 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d3000-5de0-4adb-a730-ce356d58a1a8 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:18.934105 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:18.945648 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be63e077-e484-47b3-b021-5ecb973dcf60 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:18.986987 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe5f7f-3f4c-4c86-b2d9-71ef60a91bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:18.987721 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe5f7f-3f4c-4c86-b2d9-71ef60a91bcd None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:18.988087 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe5f7f-3f4c-4c86-b2d9-71ef60a91bcd None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:18.988420 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe5f7f-3f4c-4c86-b2d9-71ef60a91bcd None admin] PATH_INFO: `/v3/groups/6f4f8385258445a7bb735241629126a1` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:18.990241 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe5f7f-3f4c-4c86-b2d9-71ef60a91bcd None admin] RBAC: Authorizing `identity:get_group(group_id=6f4f8385258445a7bb735241629126a1)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:18.991372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:18.992150 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe5f7f-3f4c-4c86-b2d9-71ef60a91bcd None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:18.994023 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 204/406] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 21 11:49:18 2022] GET /identity/v3/groups/6f4f8385258445a7bb735241629126a1 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:19.000816 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09659713-c73c-41a1-bceb-fe72098c4d2f None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:19.001100 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09659713-c73c-41a1-bceb-fe72098c4d2f None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:19.001368 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09659713-c73c-41a1-bceb-fe72098c4d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:19.023667 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-09659713-c73c-41a1-bceb-fe72098c4d2f None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:19.025184 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-09659713-c73c-41a1-bceb-fe72098c4d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:19.052050 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d3000-5de0-4adb-a730-ce356d58a1a8 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:19.094750 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb1ade-754a-4b33-a6b1-d6f66c6e1488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:19.095763 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb1ade-754a-4b33-a6b1-d6f66c6e1488 None admin] REQUEST_METHOD: `PUT` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:19.096234 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb1ade-754a-4b33-a6b1-d6f66c6e1488 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:19.096645 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb1ade-754a-4b33-a6b1-d6f66c6e1488 None admin] PATH_INFO: `/v3/projects/266db3a9097e4be4adb44df90ab84a02/groups/6f4f8385258445a7bb735241629126a1/roles/165db5ccce0540569e708b81df7a5577` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:19.099771 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb1ade-754a-4b33-a6b1-d6f66c6e1488 None admin] RBAC: Authorizing `identity:create_grant(project_id=266db3a9097e4be4adb44df90ab84a02, group_id=6f4f8385258445a7bb735241629126a1, role_id=165db5ccce0540569e708b81df7a5577)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:19.101718 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb1ade-754a-4b33-a6b1-d6f66c6e1488 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:19.107028 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 205/407] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:49:19.112275 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09659713-c73c-41a1-bceb-fe72098c4d2f None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:19.129849 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 203/408] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Sep 21 11:49:18 2022] PUT /identity/v3/projects/266db3a9097e4be4adb44df90ab84a02/groups/6f4f8385258445a7bb735241629126a1/roles/165db5ccce0540569e708b81df7a5577 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 11:49:19.259884 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:19.271768 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09659713-c73c-41a1-bceb-fe72098c4d2f None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:19.318463 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f54cb8-3105-42ef-8332-08ce216ad0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:19.319108 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f54cb8-3105-42ef-8332-08ce216ad0e2 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:19.319383 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f54cb8-3105-42ef-8332-08ce216ad0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:19.319651 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f54cb8-3105-42ef-8332-08ce216ad0e2 None admin] PATH_INFO: `/v3/projects/266db3a9097e4be4adb44df90ab84a02` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:19.320847 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f54cb8-3105-42ef-8332-08ce216ad0e2 None admin] RBAC: Authorizing `identity:get_project(project_id=266db3a9097e4be4adb44df90ab84a02)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:19.322320 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f54cb8-3105-42ef-8332-08ce216ad0e2 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:19.324399 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 206/409] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:49:19 2022] GET /identity/v3/projects/266db3a9097e4be4adb44df90ab84a02 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:19.330280 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb1ade-754a-4b33-a6b1-d6f66c6e1488 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:19.451465 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb1ade-754a-4b33-a6b1-d6f66c6e1488 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:19.465910 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:19.492688 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75cd05d-2a52-4904-aced-c8cb1f8ec004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:19.493346 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cd05d-2a52-4904-aced-c8cb1f8ec004 None admin] REQUEST_METHOD: `PUT` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:19.493619 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cd05d-2a52-4904-aced-c8cb1f8ec004 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:19.493882 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cd05d-2a52-4904-aced-c8cb1f8ec004 None admin] PATH_INFO: `/v3/projects/266db3a9097e4be4adb44df90ab84a02/groups/6f4f8385258445a7bb735241629126a1/roles/c163d39b46d24a27a76fb9026fec24ff` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:19.496481 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75cd05d-2a52-4904-aced-c8cb1f8ec004 None admin] RBAC: Authorizing `identity:create_grant(project_id=266db3a9097e4be4adb44df90ab84a02, group_id=6f4f8385258445a7bb735241629126a1, role_id=c163d39b46d24a27a76fb9026fec24ff)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:19.497906 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75cd05d-2a52-4904-aced-c8cb1f8ec004 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:19.514958 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 204/410] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Sep 21 11:49:19 2022] PUT /identity/v3/projects/266db3a9097e4be4adb44df90ab84a02/groups/6f4f8385258445a7bb735241629126a1/roles/c163d39b46d24a27a76fb9026fec24ff => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 11:49:19.527515 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f54cb8-3105-42ef-8332-08ce216ad0e2 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:19.697248 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f54cb8-3105-42ef-8332-08ce216ad0e2 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:19.753837 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe4604-213e-4051-a961-2802e5e124b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:19.754490 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe4604-213e-4051-a961-2802e5e124b7 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:19.754760 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe4604-213e-4051-a961-2802e5e124b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:19.755026 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe4604-213e-4051-a961-2802e5e124b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:19.770579 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe4604-213e-4051-a961-2802e5e124b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:19.775328 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-d3fe4604-213e-4051-a961-2802e5e124b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:49:19.775328 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:19.775328 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:19.775328 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:19.775328 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:19.775328 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:19.775328 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:19.775328 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:19.775328 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:19.775328 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:19.775328 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:19.775328 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:19.775328 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:19.775328 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:19.775328 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:19.775328 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:19.776444 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:19.776444 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:19.776444 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:19.776444 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:19.776444 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:19.776444 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:19.776444 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:19.776444 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:19.776444 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:19.776444 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:19.776444 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:19.776444 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:19.776444 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:19.776444 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:19.776444 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:19.776444 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:19.777996 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:19.777996 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:19.777996 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:19.777996 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:19.777996 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:19.777996 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:19.777996 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:19.777996 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:19.777996 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:19.777996 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:19.777996 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:49:19.777996 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:19.779236 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 207/411] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 11:49:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:19.784066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75cd05d-2a52-4904-aced-c8cb1f8ec004 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:19.909367 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75cd05d-2a52-4904-aced-c8cb1f8ec004 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:19.956842 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ad4d6-5811-49f3-b16b-774b3036c4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:19.957690 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ad4d6-5811-49f3-b16b-774b3036c4be None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:19.958113 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ad4d6-5811-49f3-b16b-774b3036c4be None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:19.958541 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ad4d6-5811-49f3-b16b-774b3036c4be None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:19.959355 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ad4d6-5811-49f3-b16b-774b3036c4be None admin] RBAC: Adding query filter params (name=admin) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:19.959796 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ad4d6-5811-49f3-b16b-774b3036c4be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:19.961358 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ad4d6-5811-49f3-b16b-774b3036c4be None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:19.970609 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 205/412] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:49:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:19.976437 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe4604-213e-4051-a961-2802e5e124b7 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:20.002399 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:20.116023 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe4604-213e-4051-a961-2802e5e124b7 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:20.166631 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abbd20-f463-4384-8aae-47a103983f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:20.168181 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abbd20-f463-4384-8aae-47a103983f92 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:20.168463 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abbd20-f463-4384-8aae-47a103983f92 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:20.168731 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abbd20-f463-4384-8aae-47a103983f92 None admin] PATH_INFO: `/v3/groups/f0522bc6d2ec45e8b2c1ff6a01f1e9d3` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:20.169862 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51abbd20-f463-4384-8aae-47a103983f92 None admin] RBAC: Authorizing `identity:get_group(group_id=f0522bc6d2ec45e8b2c1ff6a01f1e9d3)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:20.171306 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51abbd20-f463-4384-8aae-47a103983f92 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:20.173197 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 208/413] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 21 11:49:19 2022] GET /identity/v3/groups/f0522bc6d2ec45e8b2c1ff6a01f1e9d3 => generated 229 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:49:20.178718 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ad4d6-5811-49f3-b16b-774b3036c4be None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:20.222857 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:20.293725 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ad4d6-5811-49f3-b16b-774b3036c4be None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:20.335284 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11e8be-afd9-443c-93d3-7ae1c60597c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:20.335914 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11e8be-afd9-443c-93d3-7ae1c60597c7 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:20.340269 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11e8be-afd9-443c-93d3-7ae1c60597c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:20.340550 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11e8be-afd9-443c-93d3-7ae1c60597c7 None admin] PATH_INFO: `/v3/projects/e314d339abaf4ce28ec0c1d1e6483dff` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:20.341891 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11e8be-afd9-443c-93d3-7ae1c60597c7 None admin] RBAC: Authorizing `identity:get_project(project_id=e314d339abaf4ce28ec0c1d1e6483dff)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:20.343338 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11e8be-afd9-443c-93d3-7ae1c60597c7 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:20.345301 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 206/414] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:49:20 2022] GET /identity/v3/projects/e314d339abaf4ce28ec0c1d1e6483dff => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:20.350929 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abbd20-f463-4384-8aae-47a103983f92 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:20.472908 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:20.491221 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abbd20-f463-4384-8aae-47a103983f92 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:20.539744 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230944df-2a87-456a-9dc5-067d3ec82c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:20.540424 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230944df-2a87-456a-9dc5-067d3ec82c59 None admin] REQUEST_METHOD: `PUT` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:20.540700 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230944df-2a87-456a-9dc5-067d3ec82c59 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:20.540971 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230944df-2a87-456a-9dc5-067d3ec82c59 None admin] PATH_INFO: `/v3/projects/e314d339abaf4ce28ec0c1d1e6483dff/groups/f0522bc6d2ec45e8b2c1ff6a01f1e9d3/roles/d1f3d1431da145709a5e9b374f3b403d` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:20.543684 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230944df-2a87-456a-9dc5-067d3ec82c59 None admin] RBAC: Authorizing `identity:create_grant(project_id=e314d339abaf4ce28ec0c1d1e6483dff, group_id=f0522bc6d2ec45e8b2c1ff6a01f1e9d3, role_id=d1f3d1431da145709a5e9b374f3b403d)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:20.545135 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230944df-2a87-456a-9dc5-067d3ec82c59 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:20.567898 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 209/415] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Sep 21 11:49:20 2022] PUT /identity/v3/projects/e314d339abaf4ce28ec0c1d1e6483dff/groups/f0522bc6d2ec45e8b2c1ff6a01f1e9d3/roles/d1f3d1431da145709a5e9b374f3b403d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 11:49:20.712558 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52131d1c-55ee-4f7a-96e0-fe56e06e7be9 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:20.712916 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52131d1c-55ee-4f7a-96e0-fe56e06e7be9 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:20.713099 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52131d1c-55ee-4f7a-96e0-fe56e06e7be9 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:20.715369 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 207/416] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:20.721280 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4234c-14f0-4125-8d41-cd2b2df343dd None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:20.721580 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4234c-14f0-4125-8d41-cd2b2df343dd None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:20.721824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4234c-14f0-4125-8d41-cd2b2df343dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:20.740880 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-78a4234c-14f0-4125-8d41-cd2b2df343dd None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:20.741968 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-78a4234c-14f0-4125-8d41-cd2b2df343dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:20.847934 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 210/417] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:49:21.232210 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f96d44-6014-4111-a771-b5f4f9a0d89a None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:21.232768 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f96d44-6014-4111-a771-b5f4f9a0d89a None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:21.232768 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f96d44-6014-4111-a771-b5f4f9a0d89a None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:21.234070 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 208/418] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:21.239324 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72c8a5-6ff3-4d76-9579-022a5fc08135 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:21.239717 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72c8a5-6ff3-4d76-9579-022a5fc08135 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:21.239877 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72c8a5-6ff3-4d76-9579-022a5fc08135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:21.263044 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-4f72c8a5-6ff3-4d76-9579-022a5fc08135 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:21.264259 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-4f72c8a5-6ff3-4d76-9579-022a5fc08135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:21.357717 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 211/419] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:49:21.371952 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f96d44-6014-4111-a771-b5f4f9a0d89a None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:21.484379 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f96d44-6014-4111-a771-b5f4f9a0d89a None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:21.504361 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:21.519055 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb66a4f-ce32-495e-8cd1-8135ddc5574f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:21.519651 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb66a4f-ce32-495e-8cd1-8135ddc5574f None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:21.519931 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb66a4f-ce32-495e-8cd1-8135ddc5574f None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:21.520351 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb66a4f-ce32-495e-8cd1-8135ddc5574f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:21.532892 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb66a4f-ce32-495e-8cd1-8135ddc5574f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:21.537845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-5bb66a4f-ce32-495e-8cd1-8135ddc5574f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:49:21.537845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:21.537845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:21.537845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:21.537845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:21.537845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:21.537845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:21.537845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:21.537845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:21.537845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:21.537845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:21.537845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:21.537845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:21.537845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:21.537845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:21.537845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:21.538720 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:21.538720 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:21.538720 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:21.538720 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:21.538720 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:21.538720 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:21.538720 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:21.538720 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:21.538720 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:21.538720 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:21.538720 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:21.538720 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:21.538720 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:21.538720 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:21.538720 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:21.538720 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:21.539553 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:21.539553 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:21.539553 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:21.539553 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:21.539553 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:21.539553 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:21.539553 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:21.539553 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:21.539553 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:21.539553 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:21.539553 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:49:21.539553 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:21.539553 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 209/420] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:49:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:21.549159 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72c8a5-6ff3-4d76-9579-022a5fc08135 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:21.562812 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:21.708300 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72c8a5-6ff3-4d76-9579-022a5fc08135 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:21.763262 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b210e14-1035-4056-be63-f85c627b95cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:21.763799 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b210e14-1035-4056-be63-f85c627b95cb None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:21.764097 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b210e14-1035-4056-be63-f85c627b95cb None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:21.764459 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b210e14-1035-4056-be63-f85c627b95cb None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:21.765101 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b210e14-1035-4056-be63-f85c627b95cb None admin] RBAC: Adding query filter params (name=member) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:21.765401 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b210e14-1035-4056-be63-f85c627b95cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:21.766824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b210e14-1035-4056-be63-f85c627b95cb None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:21.777392 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 212/421] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 11:49:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:21.783392 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb66a4f-ce32-495e-8cd1-8135ddc5574f None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:21.932735 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb66a4f-ce32-495e-8cd1-8135ddc5574f None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:21.955278 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b210e14-1035-4056-be63-f85c627b95cb None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:21.985498 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f743ce-2fdc-480e-93f1-1f55e40c800a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:21.986117 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f743ce-2fdc-480e-93f1-1f55e40c800a None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:21.986395 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f743ce-2fdc-480e-93f1-1f55e40c800a None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:21.986662 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f743ce-2fdc-480e-93f1-1f55e40c800a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:22.052427 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:22.073609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:22.100418 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f743ce-2fdc-480e-93f1-1f55e40c800a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:22.102021 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f743ce-2fdc-480e-93f1-1f55e40c800a None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:22.146232 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b210e14-1035-4056-be63-f85c627b95cb None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:22.218814 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a1778-16b1-4471-be8f-ff9f88d53445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:22.219450 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a1778-16b1-4471-be8f-ff9f88d53445 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:22.219726 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a1778-16b1-4471-be8f-ff9f88d53445 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:22.220018 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a1778-16b1-4471-be8f-ff9f88d53445 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:22.238368 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 210/422] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:49:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:49:22.239630 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc44026-1368-4d14-a5b5-db2b38332d83 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:22.239920 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc44026-1368-4d14-a5b5-db2b38332d83 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:22.240215 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc44026-1368-4d14-a5b5-db2b38332d83 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:22.241438 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a1778-16b1-4471-be8f-ff9f88d53445 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:22.241834 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 211/423] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:22.246907 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc44026-1368-4d14-a5b5-db2b38332d83 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:22.248422 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-2a7a1778-16b1-4471-be8f-ff9f88d53445 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 11:49:22.248422 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:22.248422 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:22.248422 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:22.248422 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:22.248422 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:22.248422 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:22.248422 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:22.248422 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:22.248422 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:22.248422 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:22.248422 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:22.248422 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:22.248422 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:22.248422 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:22.248422 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:22.249496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:22.249496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:22.249496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:22.249496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:22.249496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:22.249496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:22.249496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:22.249496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:22.249496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:22.249496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:22.249496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:22.249496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:22.249496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:22.249496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:22.249496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:22.249496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:22.250286 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:22.250286 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:22.250286 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:22.250286 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:22.250286 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:22.250286 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:22.250286 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:22.250286 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:22.250286 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:22.250286 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:22.250286 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 11:49:22.250286 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:22.253520 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 213/424] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 11:49:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 11:49:22.254994 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf654ce9-9e8b-45dd-a15b-a6d2caf76063 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:22.255416 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf654ce9-9e8b-45dd-a15b-a6d2caf76063 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:22.255824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf654ce9-9e8b-45dd-a15b-a6d2caf76063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:22.282518 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-cf654ce9-9e8b-45dd-a15b-a6d2caf76063 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:22.284454 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-cf654ce9-9e8b-45dd-a15b-a6d2caf76063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:22.327510 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:22.373058 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc44026-1368-4d14-a5b5-db2b38332d83 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:22.375098 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 214/425] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:49:22.376330 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf654ce9-9e8b-45dd-a15b-a6d2caf76063 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:22.411908 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ebaa2-145b-41c6-8c44-9533465acd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:22.413334 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ebaa2-145b-41c6-8c44-9533465acd78 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:22.413829 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ebaa2-145b-41c6-8c44-9533465acd78 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:22.414290 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ebaa2-145b-41c6-8c44-9533465acd78 None admin] PATH_INFO: `/v3/projects/9717263f7d4a452e9bf8dfa0907bda95` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:22.415593 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ebaa2-145b-41c6-8c44-9533465acd78 None admin] RBAC: Authorizing `identity:get_project(project_id=9717263f7d4a452e9bf8dfa0907bda95)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:22.417813 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ebaa2-145b-41c6-8c44-9533465acd78 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:22.419959 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 212/426] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:49:22 2022] GET /identity/v3/projects/9717263f7d4a452e9bf8dfa0907bda95 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:22.425253 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ebaa2-145b-41c6-8c44-9533465acd78 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:22.468441 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:22.508639 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf654ce9-9e8b-45dd-a15b-a6d2caf76063 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:22.537719 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ebaa2-145b-41c6-8c44-9533465acd78 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:22.545254 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b6370-8379-4a00-8f95-c3487c34b697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:22.546081 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b6370-8379-4a00-8f95-c3487c34b697 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:22.546501 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b6370-8379-4a00-8f95-c3487c34b697 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:22.547013 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b6370-8379-4a00-8f95-c3487c34b697 None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:22.547874 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b6370-8379-4a00-8f95-c3487c34b697 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:22.548420 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b6370-8379-4a00-8f95-c3487c34b697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:22.550345 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b6370-8379-4a00-8f95-c3487c34b697 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:22.559865 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 215/427] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:49:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:22.561514 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f192f1-d80d-4318-96bb-78799f48dea4 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:22.561997 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f192f1-d80d-4318-96bb-78799f48dea4 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:22.562481 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f192f1-d80d-4318-96bb-78799f48dea4 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:22.568376 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 216/428] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:22.569528 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f192f1-d80d-4318-96bb-78799f48dea4 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:22.570115 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:22.577920 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b589d3-f78e-4a2c-8613-c38758ef114b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:22.578477 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b589d3-f78e-4a2c-8613-c38758ef114b None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:22.578752 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b589d3-f78e-4a2c-8613-c38758ef114b None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:22.579015 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b589d3-f78e-4a2c-8613-c38758ef114b None admin] PATH_INFO: `/v3/groups/6f4f8385258445a7bb735241629126a1` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:22.580138 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b589d3-f78e-4a2c-8613-c38758ef114b None admin] RBAC: Authorizing `identity:get_group(group_id=6f4f8385258445a7bb735241629126a1)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:22.581579 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b589d3-f78e-4a2c-8613-c38758ef114b None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:22.588276 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 213/429] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 21 11:49:22 2022] GET /identity/v3/groups/6f4f8385258445a7bb735241629126a1 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:49:22.588276 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46263c3-553f-41b1-b01c-750ae4ee1aa9 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:22.588276 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46263c3-553f-41b1-b01c-750ae4ee1aa9 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:22.588276 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46263c3-553f-41b1-b01c-750ae4ee1aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:22.609257 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-f46263c3-553f-41b1-b01c-750ae4ee1aa9 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:22.610946 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-f46263c3-553f-41b1-b01c-750ae4ee1aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:22.686297 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 214/430] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:49:22.687362 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46263c3-553f-41b1-b01c-750ae4ee1aa9 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:22.729484 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f192f1-d80d-4318-96bb-78799f48dea4 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:22.760291 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:22.779865 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e629cd-dc34-4309-b775-6d7a62a99e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:22.780832 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e629cd-dc34-4309-b775-6d7a62a99e72 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:22.781115 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e629cd-dc34-4309-b775-6d7a62a99e72 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:22.781434 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e629cd-dc34-4309-b775-6d7a62a99e72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:22.803426 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46263c3-553f-41b1-b01c-750ae4ee1aa9 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:22.838291 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:22.849942 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feadfae-f233-42be-b022-0b9e8ef14ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:22.850800 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feadfae-f233-42be-b022-0b9e8ef14ee7 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:22.851212 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feadfae-f233-42be-b022-0b9e8ef14ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:22.851543 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feadfae-f233-42be-b022-0b9e8ef14ee7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:22.852616 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feadfae-f233-42be-b022-0b9e8ef14ee7 None admin] RBAC: Adding query filter params (group.id=6f4f8385258445a7bb735241629126a1, role.id=165db5ccce0540569e708b81df7a5577, scope.project.id=9717263f7d4a452e9bf8dfa0907bda95) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:22.853270 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feadfae-f233-42be-b022-0b9e8ef14ee7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:22.855239 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feadfae-f233-42be-b022-0b9e8ef14ee7 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:22.864073 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 215/431] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 21 11:49:22 2022] GET /identity/v3/role_assignments?group.id=6f4f8385258445a7bb735241629126a1&scope.project.id=9717263f7d4a452e9bf8dfa0907bda95&role.id=165db5ccce0540569e708b81df7a5577 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:22.865282 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feadfae-f233-42be-b022-0b9e8ef14ee7 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:22.866242 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e629cd-dc34-4309-b775-6d7a62a99e72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:22.867751 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e629cd-dc34-4309-b775-6d7a62a99e72 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:23.028669 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 217/432] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:49:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:49:23.034619 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e629cd-dc34-4309-b775-6d7a62a99e72 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:23.071631 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feadfae-f233-42be-b022-0b9e8ef14ee7 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:23.084396 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:23.114801 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7571f2-53cc-4c79-b9a9-c2a427047b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:23.116670 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7571f2-53cc-4c79-b9a9-c2a427047b09 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:23.118730 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7571f2-53cc-4c79-b9a9-c2a427047b09 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:23.119012 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7571f2-53cc-4c79-b9a9-c2a427047b09 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:23.141135 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7571f2-53cc-4c79-b9a9-c2a427047b09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:23.147794 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-4b7571f2-53cc-4c79-b9a9-c2a427047b09 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 11:49:23.147794 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:23.147794 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:23.147794 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:23.147794 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:23.147794 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:23.147794 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:23.147794 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:23.147794 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:23.147794 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:23.147794 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:23.147794 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:23.147794 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:23.147794 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:23.147794 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:23.147794 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:23.148710 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:23.148710 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:23.148710 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:23.148710 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:23.148710 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:23.148710 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:23.148710 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:23.148710 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:23.148710 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:23.148710 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:23.148710 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:23.148710 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:23.148710 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:23.148710 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:23.148710 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:23.148710 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:23.149510 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:23.149510 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:23.149510 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:23.149510 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:23.149510 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:23.149510 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:23.149510 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:23.149510 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:23.149510 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:23.149510 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:23.149510 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 11:49:23.149510 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:23.150121 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 216/433] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 11:49:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:23.150705 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7571f2-53cc-4c79-b9a9-c2a427047b09 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:23.211809 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e629cd-dc34-4309-b775-6d7a62a99e72 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:23.226146 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:23.260811 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c54b6b-f6ce-42cc-8a9c-5a3c59727317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:23.262736 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c54b6b-f6ce-42cc-8a9c-5a3c59727317 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:23.263156 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c54b6b-f6ce-42cc-8a9c-5a3c59727317 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:23.263969 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c54b6b-f6ce-42cc-8a9c-5a3c59727317 None admin] PATH_INFO: `/v3/projects/9717263f7d4a452e9bf8dfa0907bda95` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:23.265546 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c54b6b-f6ce-42cc-8a9c-5a3c59727317 None admin] RBAC: Authorizing `identity:get_project(project_id=9717263f7d4a452e9bf8dfa0907bda95)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:23.266979 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c54b6b-f6ce-42cc-8a9c-5a3c59727317 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:23.268926 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 218/434] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:49:23 2022] GET /identity/v3/projects/9717263f7d4a452e9bf8dfa0907bda95 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:49:23.269687 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c54b6b-f6ce-42cc-8a9c-5a3c59727317 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:23.292750 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7571f2-53cc-4c79-b9a9-c2a427047b09 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:23.338438 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd9832-d3d8-497d-ad29-a6e1ce9bca1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:23.338838 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd9832-d3d8-497d-ad29-a6e1ce9bca1b None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:23.339108 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd9832-d3d8-497d-ad29-a6e1ce9bca1b None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:23.339375 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd9832-d3d8-497d-ad29-a6e1ce9bca1b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:23.352626 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd9832-d3d8-497d-ad29-a6e1ce9bca1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:23.358523 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-45cd9832-d3d8-497d-ad29-a6e1ce9bca1b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:49:23.358523 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:23.358523 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:23.358523 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:23.358523 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:23.358523 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:23.358523 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:23.358523 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:23.358523 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:23.358523 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:23.358523 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:23.358523 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:23.358523 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:23.358523 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:23.358523 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:23.358523 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:23.359610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:23.359610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:23.359610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:23.359610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:23.359610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:23.359610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:23.359610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:23.359610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:23.359610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:23.359610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:23.359610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:23.359610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:23.359610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:23.359610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:23.359610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:23.359610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:23.360610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:23.360610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:23.360610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:23.360610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:23.360610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:23.360610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:23.360610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:23.360610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:23.360610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:23.360610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:23.360610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 11:49:23.360610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:23.360610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 217/435] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:49:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:23.360610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd9832-d3d8-497d-ad29-a6e1ce9bca1b None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:23.389152 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:23.405805 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c54b6b-f6ce-42cc-8a9c-5a3c59727317 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:23.457142 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af0d53-3c4b-4041-93d2-e6771c56d548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:23.457379 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af0d53-3c4b-4041-93d2-e6771c56d548 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:23.457660 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af0d53-3c4b-4041-93d2-e6771c56d548 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:23.457924 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af0d53-3c4b-4041-93d2-e6771c56d548 None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:23.458827 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af0d53-3c4b-4041-93d2-e6771c56d548 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:23.458954 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af0d53-3c4b-4041-93d2-e6771c56d548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:23.460949 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af0d53-3c4b-4041-93d2-e6771c56d548 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:23.469563 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 219/436] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:49:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:23.470398 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af0d53-3c4b-4041-93d2-e6771c56d548 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:23.503008 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd9832-d3d8-497d-ad29-a6e1ce9bca1b None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:23.516807 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:23.537432 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b15e6-c608-4793-a190-a311d71a815b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:23.538085 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b15e6-c608-4793-a190-a311d71a815b None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:23.538360 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b15e6-c608-4793-a190-a311d71a815b None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:23.538626 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b15e6-c608-4793-a190-a311d71a815b None admin] PATH_INFO: `/v3/groups/6f4f8385258445a7bb735241629126a1` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:23.539719 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b15e6-c608-4793-a190-a311d71a815b None admin] RBAC: Authorizing `identity:get_group(group_id=6f4f8385258445a7bb735241629126a1)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:23.541166 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b15e6-c608-4793-a190-a311d71a815b None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:23.543012 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 218/437] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 21 11:49:23 2022] GET /identity/v3/groups/6f4f8385258445a7bb735241629126a1 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:23.543753 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b15e6-c608-4793-a190-a311d71a815b None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:23.591198 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af0d53-3c4b-4041-93d2-e6771c56d548 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:23.624694 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4028c25-4f20-4877-b5a8-4a0e087d96ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:23.626008 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4028c25-4f20-4877-b5a8-4a0e087d96ea None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:23.626008 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4028c25-4f20-4877-b5a8-4a0e087d96ea None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:23.626008 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4028c25-4f20-4877-b5a8-4a0e087d96ea None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:23.626585 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4028c25-4f20-4877-b5a8-4a0e087d96ea None admin] RBAC: Adding query filter params (name=member) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:23.626585 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4028c25-4f20-4877-b5a8-4a0e087d96ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:23.627964 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4028c25-4f20-4877-b5a8-4a0e087d96ea None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:23.635725 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 220/438] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 11:49:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:23.637472 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ff435-9780-40ca-b968-bed13609fbc2 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:23.637749 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ff435-9780-40ca-b968-bed13609fbc2 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:23.638112 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ff435-9780-40ca-b968-bed13609fbc2 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:23.639352 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 221/439] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:23.639967 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ff435-9780-40ca-b968-bed13609fbc2 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:23.647904 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b15e6-c608-4793-a190-a311d71a815b None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:23.655290 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:23.681445 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c89ac-5096-4c65-bcaf-0fcf34b7b5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:23.682037 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c89ac-5096-4c65-bcaf-0fcf34b7b5fe None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:23.682314 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c89ac-5096-4c65-bcaf-0fcf34b7b5fe None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:23.682584 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c89ac-5096-4c65-bcaf-0fcf34b7b5fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:23.731206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:23.740994 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ff435-9780-40ca-b968-bed13609fbc2 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:23.750052 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c89ac-5096-4c65-bcaf-0fcf34b7b5fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:23.751516 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c89ac-5096-4c65-bcaf-0fcf34b7b5fe None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:23.774003 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110d8f4-3e83-4fb0-b5f6-7ce34a3ac79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:23.774588 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110d8f4-3e83-4fb0-b5f6-7ce34a3ac79a None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:23.774857 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110d8f4-3e83-4fb0-b5f6-7ce34a3ac79a None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:23.775120 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110d8f4-3e83-4fb0-b5f6-7ce34a3ac79a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:23.775827 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e110d8f4-3e83-4fb0-b5f6-7ce34a3ac79a None admin] RBAC: Adding query filter params (group.id=6f4f8385258445a7bb735241629126a1, role.id=c163d39b46d24a27a76fb9026fec24ff, scope.project.id=9717263f7d4a452e9bf8dfa0907bda95) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:23.776163 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e110d8f4-3e83-4fb0-b5f6-7ce34a3ac79a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:23.777572 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e110d8f4-3e83-4fb0-b5f6-7ce34a3ac79a None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:23.783233 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 222/440] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 21 11:49:23 2022] GET /identity/v3/role_assignments?group.id=6f4f8385258445a7bb735241629126a1&scope.project.id=9717263f7d4a452e9bf8dfa0907bda95&role.id=c163d39b46d24a27a76fb9026fec24ff => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:23.783837 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110d8f4-3e83-4fb0-b5f6-7ce34a3ac79a None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:23.864513 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 219/441] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:49:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:49:23.864513 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e21de7-4a22-4477-bc85-d6d9508e7e39 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:23.864513 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e21de7-4a22-4477-bc85-d6d9508e7e39 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:23.864513 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e21de7-4a22-4477-bc85-d6d9508e7e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:23.877924 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:23.882508 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-c6e21de7-4a22-4477-bc85-d6d9508e7e39 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:23.883814 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-c6e21de7-4a22-4477-bc85-d6d9508e7e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:23.904362 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110d8f4-3e83-4fb0-b5f6-7ce34a3ac79a None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:23.941225 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7273a69-7fdc-4fd6-9dc9-01eb94390298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:23.941840 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7273a69-7fdc-4fd6-9dc9-01eb94390298 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:23.942129 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7273a69-7fdc-4fd6-9dc9-01eb94390298 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:23.942398 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7273a69-7fdc-4fd6-9dc9-01eb94390298 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:23.959294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 220/442] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:49:23.960228 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e21de7-4a22-4477-bc85-d6d9508e7e39 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:23.976770 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:24.044235 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7273a69-7fdc-4fd6-9dc9-01eb94390298 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:24.046123 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7273a69-7fdc-4fd6-9dc9-01eb94390298 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:24.084645 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e21de7-4a22-4477-bc85-d6d9508e7e39 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:24.131983 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13161d-5c91-4d6d-a4ca-9bfc341c27a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:24.132638 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13161d-5c91-4d6d-a4ca-9bfc341c27a9 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:24.132914 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13161d-5c91-4d6d-a4ca-9bfc341c27a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:24.133181 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13161d-5c91-4d6d-a4ca-9bfc341c27a9 None admin] PATH_INFO: `/v3/projects/266db3a9097e4be4adb44df90ab84a02` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:24.134297 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13161d-5c91-4d6d-a4ca-9bfc341c27a9 None admin] RBAC: Authorizing `identity:get_project(project_id=266db3a9097e4be4adb44df90ab84a02)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:24.135741 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13161d-5c91-4d6d-a4ca-9bfc341c27a9 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:24.138365 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 221/443] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:49:23 2022] GET /identity/v3/projects/266db3a9097e4be4adb44df90ab84a02 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:24.142009 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:24.144401 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13161d-5c91-4d6d-a4ca-9bfc341c27a9 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:24.176214 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 223/444] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:49:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:49:24.177959 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7273a69-7fdc-4fd6-9dc9-01eb94390298 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:24.249917 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:24.280636 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13161d-5c91-4d6d-a4ca-9bfc341c27a9 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:24.314364 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7273a69-7fdc-4fd6-9dc9-01eb94390298 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:24.321834 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157558b9-34be-4bd1-aba1-f6a9ad261690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:24.322448 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157558b9-34be-4bd1-aba1-f6a9ad261690 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:24.322719 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157558b9-34be-4bd1-aba1-f6a9ad261690 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:24.322981 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157558b9-34be-4bd1-aba1-f6a9ad261690 None admin] PATH_INFO: `/v3/groups/6f4f8385258445a7bb735241629126a1` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:24.324141 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157558b9-34be-4bd1-aba1-f6a9ad261690 None admin] RBAC: Authorizing `identity:get_group(group_id=6f4f8385258445a7bb735241629126a1)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:24.325549 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157558b9-34be-4bd1-aba1-f6a9ad261690 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:24.327082 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 222/445] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 21 11:49:24 2022] GET /identity/v3/groups/6f4f8385258445a7bb735241629126a1 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:24.327858 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157558b9-34be-4bd1-aba1-f6a9ad261690 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:24.348840 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c623c-eb44-4e6b-ac56-dd5c07863b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:24.349455 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c623c-eb44-4e6b-ac56-dd5c07863b02 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:24.349725 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c623c-eb44-4e6b-ac56-dd5c07863b02 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:24.349987 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c623c-eb44-4e6b-ac56-dd5c07863b02 None admin] PATH_INFO: `/v3/projects/266db3a9097e4be4adb44df90ab84a02` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:24.351090 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c623c-eb44-4e6b-ac56-dd5c07863b02 None admin] RBAC: Authorizing `identity:get_project(project_id=266db3a9097e4be4adb44df90ab84a02)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:24.352544 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c623c-eb44-4e6b-ac56-dd5c07863b02 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:24.354130 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 224/446] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:49:24 2022] GET /identity/v3/projects/266db3a9097e4be4adb44df90ab84a02 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:49:24.355448 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c623c-eb44-4e6b-ac56-dd5c07863b02 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:24.401738 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:24.435315 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157558b9-34be-4bd1-aba1-f6a9ad261690 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:24.461867 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c623c-eb44-4e6b-ac56-dd5c07863b02 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:24.471351 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ec360-6b28-454a-9d77-3ac6ef29a31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:24.472217 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ec360-6b28-454a-9d77-3ac6ef29a31c None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:24.472484 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ec360-6b28-454a-9d77-3ac6ef29a31c None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:24.472747 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ec360-6b28-454a-9d77-3ac6ef29a31c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:24.483636 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ec360-6b28-454a-9d77-3ac6ef29a31c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:24.489307 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-bc1ec360-6b28-454a-9d77-3ac6ef29a31c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:49:24.489307 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:24.489307 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:24.489307 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:24.489307 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:24.489307 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:24.489307 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:24.489307 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:24.489307 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:24.489307 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:24.489307 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:24.489307 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:24.489307 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:24.489307 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:24.489307 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:24.489307 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:24.490209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:24.490209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:24.490209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:24.490209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:24.490209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:24.490209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:24.490209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:24.490209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:24.490209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:24.490209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:24.490209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:24.490209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:24.490209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:24.490209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:24.490209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:24.490209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:24.491028 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:24.491028 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:24.491028 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:24.491028 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:24.491028 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:24.491028 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:24.491028 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:24.491028 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:24.491028 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:24.491028 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:24.491028 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:49:24.491028 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:24.495230 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 223/447] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 11:49:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:24.496936 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ec360-6b28-454a-9d77-3ac6ef29a31c None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:24.506956 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dd33a-82e8-49c4-999f-c2d559f9bc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:24.507558 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dd33a-82e8-49c4-999f-c2d559f9bc5e None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:24.507827 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dd33a-82e8-49c4-999f-c2d559f9bc5e None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:24.508128 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dd33a-82e8-49c4-999f-c2d559f9bc5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:24.508841 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5dd33a-82e8-49c4-999f-c2d559f9bc5e None admin] RBAC: Adding query filter params (group.id=6f4f8385258445a7bb735241629126a1, role.id=c163d39b46d24a27a76fb9026fec24ff, scope.project.id=266db3a9097e4be4adb44df90ab84a02) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:24.509141 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5dd33a-82e8-49c4-999f-c2d559f9bc5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:24.509412 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:24.510578 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5dd33a-82e8-49c4-999f-c2d559f9bc5e None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:24.517983 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 225/448] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 21 11:49:24 2022] GET /identity/v3/role_assignments?group.id=6f4f8385258445a7bb735241629126a1&scope.project.id=266db3a9097e4be4adb44df90ab84a02&role.id=c163d39b46d24a27a76fb9026fec24ff => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:24.518659 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dd33a-82e8-49c4-999f-c2d559f9bc5e None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:24.649886 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dd33a-82e8-49c4-999f-c2d559f9bc5e None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:24.652096 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ec360-6b28-454a-9d77-3ac6ef29a31c None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:24.661207 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:24.696609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f3bc6-76f1-4d98-8140-c5dd9cb79724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:24.697041 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f3bc6-76f1-4d98-8140-c5dd9cb79724 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:24.704021 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f3bc6-76f1-4d98-8140-c5dd9cb79724 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:24.704021 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f3bc6-76f1-4d98-8140-c5dd9cb79724 None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:24.704021 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f3bc6-76f1-4d98-8140-c5dd9cb79724 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:24.704021 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f3bc6-76f1-4d98-8140-c5dd9cb79724 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:24.704021 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f3bc6-76f1-4d98-8140-c5dd9cb79724 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:24.704496 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e919d-f694-4e18-853c-80c5144f2b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:24.704496 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e919d-f694-4e18-853c-80c5144f2b1a None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:24.704496 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e919d-f694-4e18-853c-80c5144f2b1a None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:24.704496 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e919d-f694-4e18-853c-80c5144f2b1a None admin] PATH_INFO: `/v3/groups/6f4f8385258445a7bb735241629126a1` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:24.705000 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e919d-f694-4e18-853c-80c5144f2b1a None admin] RBAC: Authorizing `identity:get_group(group_id=6f4f8385258445a7bb735241629126a1)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:24.706459 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e919d-f694-4e18-853c-80c5144f2b1a None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:24.712036 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 224/449] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 21 11:49:24 2022] GET /identity/v3/groups/6f4f8385258445a7bb735241629126a1 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:24.714385 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e919d-f694-4e18-853c-80c5144f2b1a None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:24.725577 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 226/450] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:49:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:24.726548 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f3bc6-76f1-4d98-8140-c5dd9cb79724 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:24.819890 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:24.843768 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e919d-f694-4e18-853c-80c5144f2b1a None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:24.846746 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f3bc6-76f1-4d98-8140-c5dd9cb79724 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:24.877321 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa973c-3c26-4fe7-8c22-9f5385b3e3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:24.877912 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa973c-3c26-4fe7-8c22-9f5385b3e3ac None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:24.878187 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa973c-3c26-4fe7-8c22-9f5385b3e3ac None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:24.878454 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa973c-3c26-4fe7-8c22-9f5385b3e3ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:24.879160 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa973c-3c26-4fe7-8c22-9f5385b3e3ac None admin] RBAC: Adding query filter params (group.id=6f4f8385258445a7bb735241629126a1, role.id=165db5ccce0540569e708b81df7a5577, scope.project.id=266db3a9097e4be4adb44df90ab84a02) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:24.879463 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa973c-3c26-4fe7-8c22-9f5385b3e3ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:24.879552 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238450a-3a0d-42f2-a5ca-93fbd1d385ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:24.880083 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238450a-3a0d-42f2-a5ca-93fbd1d385ed None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:24.880358 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238450a-3a0d-42f2-a5ca-93fbd1d385ed None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:24.880621 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238450a-3a0d-42f2-a5ca-93fbd1d385ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:24.880930 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa973c-3c26-4fe7-8c22-9f5385b3e3ac None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:24.886839 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 225/451] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 21 11:49:24 2022] GET /identity/v3/role_assignments?group.id=6f4f8385258445a7bb735241629126a1&scope.project.id=266db3a9097e4be4adb44df90ab84a02&role.id=165db5ccce0540569e708b81df7a5577 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:49:24.921283 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:24.952507 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238450a-3a0d-42f2-a5ca-93fbd1d385ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:24.954458 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238450a-3a0d-42f2-a5ca-93fbd1d385ed None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:25.060330 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 227/452] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:49:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:49:25.066130 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa973c-3c26-4fe7-8c22-9f5385b3e3ac None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:25.165818 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa973c-3c26-4fe7-8c22-9f5385b3e3ac None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:25.199807 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b7fb2-63e3-405d-8900-a58a26cfb213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:25.200486 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b7fb2-63e3-405d-8900-a58a26cfb213 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:25.200770 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b7fb2-63e3-405d-8900-a58a26cfb213 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:25.201046 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b7fb2-63e3-405d-8900-a58a26cfb213 None admin] PATH_INFO: `/v3/projects/e314d339abaf4ce28ec0c1d1e6483dff` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:25.202165 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b7fb2-63e3-405d-8900-a58a26cfb213 None admin] RBAC: Authorizing `identity:get_project(project_id=e314d339abaf4ce28ec0c1d1e6483dff)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:25.203645 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b7fb2-63e3-405d-8900-a58a26cfb213 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:25.205239 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 226/453] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 11:49:25 2022] GET /identity/v3/projects/e314d339abaf4ce28ec0c1d1e6483dff => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:25.211010 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238450a-3a0d-42f2-a5ca-93fbd1d385ed None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:25.283393 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:25.315880 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238450a-3a0d-42f2-a5ca-93fbd1d385ed None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:25.349393 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3069f-8a86-4b84-bcf7-7f04abf3174c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:25.350003 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3069f-8a86-4b84-bcf7-7f04abf3174c None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:25.350277 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3069f-8a86-4b84-bcf7-7f04abf3174c None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:25.350539 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3069f-8a86-4b84-bcf7-7f04abf3174c None admin] PATH_INFO: `/v3/groups/f0522bc6d2ec45e8b2c1ff6a01f1e9d3` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:25.352698 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3069f-8a86-4b84-bcf7-7f04abf3174c None admin] RBAC: Authorizing `identity:get_group(group_id=f0522bc6d2ec45e8b2c1ff6a01f1e9d3)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:25.354175 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3069f-8a86-4b84-bcf7-7f04abf3174c None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:25.356439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 228/454] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 21 11:49:25 2022] GET /identity/v3/groups/f0522bc6d2ec45e8b2c1ff6a01f1e9d3 => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:25.362460 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b7fb2-63e3-405d-8900-a58a26cfb213 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:25.373805 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:25.466563 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b7fb2-63e3-405d-8900-a58a26cfb213 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:25.498087 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39710544-2647-47c4-8ee1-b76b83d0eea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:25.498667 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39710544-2647-47c4-8ee1-b76b83d0eea9 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:25.498942 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39710544-2647-47c4-8ee1-b76b83d0eea9 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:25.499206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39710544-2647-47c4-8ee1-b76b83d0eea9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:25.499909 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39710544-2647-47c4-8ee1-b76b83d0eea9 None admin] RBAC: Adding query filter params (group.id=f0522bc6d2ec45e8b2c1ff6a01f1e9d3, role.id=d1f3d1431da145709a5e9b374f3b403d, scope.project.id=e314d339abaf4ce28ec0c1d1e6483dff) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:25.500232 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39710544-2647-47c4-8ee1-b76b83d0eea9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:25.501633 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39710544-2647-47c4-8ee1-b76b83d0eea9 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:25.507072 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 227/455] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 21 11:49:25 2022] GET /identity/v3/role_assignments?group.id=f0522bc6d2ec45e8b2c1ff6a01f1e9d3&scope.project.id=e314d339abaf4ce28ec0c1d1e6483dff&role.id=d1f3d1431da145709a5e9b374f3b403d => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:49:28.242738 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3babcb7-9070-4930-bbbb-1c3827ff9413 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:28.243295 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3babcb7-9070-4930-bbbb-1c3827ff9413 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:28.243295 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3babcb7-9070-4930-bbbb-1c3827ff9413 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:28.244879 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 229/456] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:28.250763 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f94061-0f37-401c-9044-01dcb1acbc2f None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:28.251235 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f94061-0f37-401c-9044-01dcb1acbc2f None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:28.251311 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f94061-0f37-401c-9044-01dcb1acbc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:28.271286 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-78f94061-0f37-401c-9044-01dcb1acbc2f None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:28.272499 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-78f94061-0f37-401c-9044-01dcb1acbc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:28.342359 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 228/457] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:49:28.415948 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bbadc-a21b-43c9-bd77-46d67ea4f965 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:28.416283 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bbadc-a21b-43c9-bd77-46d67ea4f965 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:28.416510 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bbadc-a21b-43c9-bd77-46d67ea4f965 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:28.418947 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 230/458] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:28.424766 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98a16c-5da8-415c-9d45-39a5dc95e99a None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:28.425078 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98a16c-5da8-415c-9d45-39a5dc95e99a None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:28.425313 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98a16c-5da8-415c-9d45-39a5dc95e99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:28.431948 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:28.447427 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-bc98a16c-5da8-415c-9d45-39a5dc95e99a None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:28.448712 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-bc98a16c-5da8-415c-9d45-39a5dc95e99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:28.520184 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 229/459] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:49:28.675022 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13d72d-495a-4113-8ae8-c17597ac8cae None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:28.675650 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13d72d-495a-4113-8ae8-c17597ac8cae None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:28.676155 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13d72d-495a-4113-8ae8-c17597ac8cae None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:28.677942 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 231/460] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:28.682976 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13d72d-495a-4113-8ae8-c17597ac8cae None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:28.683309 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f58ccf-5cb3-4abc-9df6-68479bc82e7b None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:28.683593 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f58ccf-5cb3-4abc-9df6-68479bc82e7b None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:28.683858 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f58ccf-5cb3-4abc-9df6-68479bc82e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:28.713724 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-c9f58ccf-5cb3-4abc-9df6-68479bc82e7b None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:28.717270 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-c9f58ccf-5cb3-4abc-9df6-68479bc82e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:28.799982 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13d72d-495a-4113-8ae8-c17597ac8cae None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:28.812642 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 230/461] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:49:28.840456 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e3099-287f-47af-ac7c-adf82df22347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:28.841075 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e3099-287f-47af-ac7c-adf82df22347 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:28.841345 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e3099-287f-47af-ac7c-adf82df22347 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:28.841606 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e3099-287f-47af-ac7c-adf82df22347 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:28.848305 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:28.852695 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e3099-287f-47af-ac7c-adf82df22347 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:28.854165 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e3099-287f-47af-ac7c-adf82df22347 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:28.857835 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f58ccf-5cb3-4abc-9df6-68479bc82e7b None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:28.872609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-057e3099-287f-47af-ac7c-adf82df22347 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:28.872609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:28.872609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:28.872609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:28.872609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:28.872609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:28.872609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:28.872609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:28.872609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:28.872609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:28.872609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:28.872609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:28.872609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:49:28.872609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:49:28.872609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:49:28.872609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:49:28.873894 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:28.873894 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:28.873894 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:28.873894 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:28.873894 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:28.873894 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:28.873894 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:28.873894 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:28.873894 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:28.873894 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:28.873894 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:28.873894 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:28.873894 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:28.873894 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:28.873894 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:28.873894 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:28.873894 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:49:28.874939 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:49:28.874939 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:28.874939 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:28.874939 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 232/462] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 11:49:28.879520 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a188a0-4edc-4bbc-8594-11703c780d0f None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:28.879799 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a188a0-4edc-4bbc-8594-11703c780d0f None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:28.880090 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a188a0-4edc-4bbc-8594-11703c780d0f None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:28.881505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 233/463] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:28.883339 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a188a0-4edc-4bbc-8594-11703c780d0f None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:28.931797 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:28.975702 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f58ccf-5cb3-4abc-9df6-68479bc82e7b None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:29.001375 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a188a0-4edc-4bbc-8594-11703c780d0f None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:29.010780 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da2c0b-38e9-4cd7-b969-7dce2ea0d95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:29.011964 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da2c0b-38e9-4cd7-b969-7dce2ea0d95a None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:29.012257 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da2c0b-38e9-4cd7-b969-7dce2ea0d95a None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:29.012520 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da2c0b-38e9-4cd7-b969-7dce2ea0d95a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:29.022404 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da2c0b-38e9-4cd7-b969-7dce2ea0d95a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:29.023846 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da2c0b-38e9-4cd7-b969-7dce2ea0d95a None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:29.038661 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5b4cf-f18e-4cca-a21b-140f958de4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:29.039223 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-c9da2c0b-38e9-4cd7-b969-7dce2ea0d95a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:29.039223 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:29.039223 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:29.039223 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:29.039223 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:29.039223 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:29.039223 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:29.039223 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:29.039223 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:29.039223 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:29.039223 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:29.039223 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:29.039223 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:49:29.039223 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:49:29.039223 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:49:29.039223 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:49:29.040206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:29.040206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:29.040206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:29.040206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:29.040206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:29.040206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:29.040206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:29.040206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:29.040206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:29.040206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:29.040206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:29.040206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:29.040206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:29.040206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:29.040206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:29.040206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:29.040206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:49:29.041060 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:49:29.041060 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:29.041060 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:29.041234 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5b4cf-f18e-4cca-a21b-140f958de4fb None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:29.041234 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5b4cf-f18e-4cca-a21b-140f958de4fb None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:29.041234 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5b4cf-f18e-4cca-a21b-140f958de4fb None admin] PATH_INFO: `/v3/domains` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:29.041234 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5b4cf-f18e-4cca-a21b-140f958de4fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:29.041234 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5b4cf-f18e-4cca-a21b-140f958de4fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:29.042019 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5b4cf-f18e-4cca-a21b-140f958de4fb None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:29.045468 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 231/464] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 11:49:29.047010 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172b605-b016-4f5e-a445-8e736621af35 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:29.047294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172b605-b016-4f5e-a445-8e736621af35 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:29.047559 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172b605-b016-4f5e-a445-8e736621af35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:29.054491 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 234/465] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:29.055085 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5b4cf-f18e-4cca-a21b-140f958de4fb None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:29.070548 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-2172b605-b016-4f5e-a445-8e736621af35 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:29.071751 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-2172b605-b016-4f5e-a445-8e736621af35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:29.107867 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:29.146388 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 232/466] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:49:29.147204 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172b605-b016-4f5e-a445-8e736621af35 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:29.161337 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5b4cf-f18e-4cca-a21b-140f958de4fb None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:29.196279 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0b96c-75c1-4b3c-bf88-e8f85024047e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:29.196874 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0b96c-75c1-4b3c-bf88-e8f85024047e None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:29.197316 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0b96c-75c1-4b3c-bf88-e8f85024047e None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:29.197593 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0b96c-75c1-4b3c-bf88-e8f85024047e None admin] PATH_INFO: `/v3/domains` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:29.198220 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0b96c-75c1-4b3c-bf88-e8f85024047e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:29.199082 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0b96c-75c1-4b3c-bf88-e8f85024047e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:29.200233 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:29.200507 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0b96c-75c1-4b3c-bf88-e8f85024047e None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:29.216871 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 235/467] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:29.217746 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0b96c-75c1-4b3c-bf88-e8f85024047e None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:29.257269 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172b605-b016-4f5e-a445-8e736621af35 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:29.294108 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91895a87-4312-4450-9a69-4cc28fc9f574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:29.294702 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91895a87-4312-4450-9a69-4cc28fc9f574 None admin] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:29.294974 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91895a87-4312-4450-9a69-4cc28fc9f574 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:29.295240 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91895a87-4312-4450-9a69-4cc28fc9f574 None admin] PATH_INFO: `/v3/users` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:29.295923 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91895a87-4312-4450-9a69-4cc28fc9f574 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:29.297465 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91895a87-4312-4450-9a69-4cc28fc9f574 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:29.324124 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 233/468] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 21 11:49:29 2022] POST /identity/v3/users => generated 246 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 11:49:29.324124 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91895a87-4312-4450-9a69-4cc28fc9f574 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:29.340816 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0b96c-75c1-4b3c-bf88-e8f85024047e None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:29.354185 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:29.383167 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcd79b-228a-455d-9c04-03acda525748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:29.383893 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcd79b-228a-455d-9c04-03acda525748 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:29.384308 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcd79b-228a-455d-9c04-03acda525748 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:29.384687 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcd79b-228a-455d-9c04-03acda525748 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:29.397569 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdcd79b-228a-455d-9c04-03acda525748 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:29.399298 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdcd79b-228a-455d-9c04-03acda525748 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:29.416035 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-5cdcd79b-228a-455d-9c04-03acda525748 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:29.416035 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:29.416035 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:29.416035 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:29.416035 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:29.416035 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:29.416035 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:29.416035 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:29.416035 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:29.416035 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:29.416035 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:29.416035 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:29.416035 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:49:29.416035 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:49:29.416035 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:49:29.416035 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:49:29.416999 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:29.416999 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:29.416999 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:29.416999 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:29.416999 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:29.416999 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:29.416999 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:29.416999 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:29.416999 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:29.416999 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:29.416999 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:29.416999 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:29.416999 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:29.416999 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:29.416999 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:29.416999 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:29.416999 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:49:29.418158 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:49:29.418158 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:29.418158 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:29.422646 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 236/469] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:29.424022 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcd79b-228a-455d-9c04-03acda525748 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:29.452227 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91895a87-4312-4450-9a69-4cc28fc9f574 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:29.460871 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:29.494037 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d85ff0-8ea3-4526-b4a3-061b55d8a68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:29.495031 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d85ff0-8ea3-4526-b4a3-061b55d8a68c None admin] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:29.495351 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d85ff0-8ea3-4526-b4a3-061b55d8a68c None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:29.495782 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d85ff0-8ea3-4526-b4a3-061b55d8a68c None admin] PATH_INFO: `/v3/users` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:29.496580 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d85ff0-8ea3-4526-b4a3-061b55d8a68c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:29.498347 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d85ff0-8ea3-4526-b4a3-061b55d8a68c None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:29.523287 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 234/470] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 21 11:49:29 2022] POST /identity/v3/users => generated 248 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 11:49:29.524458 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d85ff0-8ea3-4526-b4a3-061b55d8a68c None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:29.550098 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcd79b-228a-455d-9c04-03acda525748 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:29.612577 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb25be-33af-4c60-ae78-6c6bd42fc506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:29.613463 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb25be-33af-4c60-ae78-6c6bd42fc506 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:29.613737 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb25be-33af-4c60-ae78-6c6bd42fc506 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:29.614004 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb25be-33af-4c60-ae78-6c6bd42fc506 None admin] PATH_INFO: `/v3/domains` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:29.614665 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb25be-33af-4c60-ae78-6c6bd42fc506 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:29.614967 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb25be-33af-4c60-ae78-6c6bd42fc506 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:29.616418 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb25be-33af-4c60-ae78-6c6bd42fc506 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:29.633590 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 237/471] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:49:29.639385 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb25be-33af-4c60-ae78-6c6bd42fc506 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:29.659265 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d85ff0-8ea3-4526-b4a3-061b55d8a68c None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:29.666133 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:29.706435 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa8383-b513-4be7-8f4d-c6c3b6fc512f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:29.707747 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa8383-b513-4be7-8f4d-c6c3b6fc512f None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:29.708272 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa8383-b513-4be7-8f4d-c6c3b6fc512f None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:29.708743 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa8383-b513-4be7-8f4d-c6c3b6fc512f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:29.722522 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa8383-b513-4be7-8f4d-c6c3b6fc512f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:29.725275 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa8383-b513-4be7-8f4d-c6c3b6fc512f None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:29.742852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-d0fa8383-b513-4be7-8f4d-c6c3b6fc512f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:29.742852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:29.742852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:29.742852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:29.742852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:29.742852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:29.742852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:29.742852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:29.742852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:29.742852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:29.742852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:29.742852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:29.742852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:49:29.742852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:49:29.742852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:49:29.742852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:49:29.743826 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:29.743826 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:29.743826 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:29.743826 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:29.743826 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:29.743826 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:29.743826 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:29.743826 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:29.743826 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:29.743826 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:29.743826 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:29.743826 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:29.743826 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:29.743826 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:29.743826 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:29.743826 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:29.743826 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:49:29.745340 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:49:29.745340 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:29.745340 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:29.745340 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 235/472] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:29.750455 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa8383-b513-4be7-8f4d-c6c3b6fc512f None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:29.764202 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:29.769852 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb25be-33af-4c60-ae78-6c6bd42fc506 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:29.810577 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bf264-f34d-4bbf-881e-ef66ff9128bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:29.811171 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bf264-f34d-4bbf-881e-ef66ff9128bd None admin] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:29.811553 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bf264-f34d-4bbf-881e-ef66ff9128bd None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:29.811829 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bf264-f34d-4bbf-881e-ef66ff9128bd None admin] PATH_INFO: `/v3/users` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:29.812591 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0bf264-f34d-4bbf-881e-ef66ff9128bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:29.814017 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0bf264-f34d-4bbf-881e-ef66ff9128bd None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:29.845075 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 238/473] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 21 11:49:29 2022] POST /identity/v3/users => generated 248 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 11:49:29.879551 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa8383-b513-4be7-8f4d-c6c3b6fc512f None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:29.919752 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bbe06-66c2-46e8-ad80-146447ae8a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:29.920417 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bbe06-66c2-46e8-ad80-146447ae8a17 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:29.920756 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bbe06-66c2-46e8-ad80-146447ae8a17 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:29.921024 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bbe06-66c2-46e8-ad80-146447ae8a17 None admin] PATH_INFO: `/v3/domains` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:29.921735 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44bbe06-66c2-46e8-ad80-146447ae8a17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:29.922038 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44bbe06-66c2-46e8-ad80-146447ae8a17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:29.923539 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44bbe06-66c2-46e8-ad80-146447ae8a17 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:29.942466 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 236/474] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:29.948427 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bf264-f34d-4bbf-881e-ef66ff9128bd None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:30.038343 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:30.062966 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bf264-f34d-4bbf-881e-ef66ff9128bd None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:30.100601 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08efe64a-64cd-4499-bca6-a368d7e78ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:30.101130 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efe64a-64cd-4499-bca6-a368d7e78ff6 None admin] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:30.101406 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efe64a-64cd-4499-bca6-a368d7e78ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:30.101675 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efe64a-64cd-4499-bca6-a368d7e78ff6 None admin] PATH_INFO: `/v3/users` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:30.102325 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08efe64a-64cd-4499-bca6-a368d7e78ff6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:30.103760 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08efe64a-64cd-4499-bca6-a368d7e78ff6 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:30.128175 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 239/475] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 21 11:49:29 2022] POST /identity/v3/users => generated 249 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 11:49:31.916527 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726b349-bd76-4854-8405-b9a59940f97d None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:31.917620 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726b349-bd76-4854-8405-b9a59940f97d None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:31.917620 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726b349-bd76-4854-8405-b9a59940f97d None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:31.919225 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 237/476] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:31.924971 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553991a6-5cc9-410f-a29f-ec8130cdacc0 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:31.925420 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553991a6-5cc9-410f-a29f-ec8130cdacc0 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:31.925492 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553991a6-5cc9-410f-a29f-ec8130cdacc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:31.945345 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-553991a6-5cc9-410f-a29f-ec8130cdacc0 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:31.946550 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-553991a6-5cc9-410f-a29f-ec8130cdacc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:32.033018 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 240/477] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 11:49:32.285033 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ce240-0617-4739-934f-d22ec534bea6 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:32.285862 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ce240-0617-4739-934f-d22ec534bea6 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:32.286340 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ce240-0617-4739-934f-d22ec534bea6 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:32.287865 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 238/478] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:32.294113 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6a24f-7fa1-4028-8d1b-6e978496010d None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:32.294645 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6a24f-7fa1-4028-8d1b-6e978496010d None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:32.295131 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6a24f-7fa1-4028-8d1b-6e978496010d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:32.313833 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-7ba6a24f-7fa1-4028-8d1b-6e978496010d None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:32.315331 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-7ba6a24f-7fa1-4028-8d1b-6e978496010d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:32.365251 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ce240-0617-4739-934f-d22ec534bea6 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:32.377505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:32.392092 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 241/479] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:49:32.439609 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba115599-af7b-49f3-9d29-dafbbdbddc21 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:32.440306 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba115599-af7b-49f3-9d29-dafbbdbddc21 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:32.440795 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba115599-af7b-49f3-9d29-dafbbdbddc21 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:32.442606 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 242/480] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 11:49:32.447561 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0eadca-0ebe-46b6-b7be-98535935affd None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:32.448610 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0eadca-0ebe-46b6-b7be-98535935affd None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:32.449074 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0eadca-0ebe-46b6-b7be-98535935affd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:32.451340 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:32.468144 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-1e0eadca-0ebe-46b6-b7be-98535935affd None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:32.469649 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-1e0eadca-0ebe-46b6-b7be-98535935affd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:32.497716 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ce240-0617-4739-934f-d22ec534bea6 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:32.548817 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 243/481] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 11:49:32.551639 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00865692-ab08-4c03-bf3c-3924483d9f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:32.552316 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00865692-ab08-4c03-bf3c-3924483d9f05 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:32.552627 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00865692-ab08-4c03-bf3c-3924483d9f05 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:32.552899 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00865692-ab08-4c03-bf3c-3924483d9f05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:32.564117 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00865692-ab08-4c03-bf3c-3924483d9f05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:32.569042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-00865692-ab08-4c03-bf3c-3924483d9f05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 11:49:32.569042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:32.569042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:32.569042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:32.569042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:32.569042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:32.569042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:32.569042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:32.569042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:32.569042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:32.569042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:32.569042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:32.569042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:32.569042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:32.569042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:32.569042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:32.569926 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:32.569926 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:32.569926 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:32.569926 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:32.569926 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:32.569926 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:32.569926 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:32.569926 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:32.569926 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:32.569926 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:32.569926 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:32.569926 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:32.569926 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:32.569926 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:32.569926 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:32.569926 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:32.570750 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:32.570750 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:32.570750 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:32.570750 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:32.570750 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:32.570750 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:32.570750 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:32.570750 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:32.570750 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:32.570750 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:32.570750 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 11:49:32.570750 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:32.570750 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 239/482] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 11:49:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:32.585549 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0eadca-0ebe-46b6-b7be-98535935affd None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:32.655088 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ed9de-2476-4f8e-9be9-d84048409198 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:32.655395 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ed9de-2476-4f8e-9be9-d84048409198 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:32.655630 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ed9de-2476-4f8e-9be9-d84048409198 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:32.657253 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 240/483] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:32.662078 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c6ac9-a88a-40fb-bb0f-f30491c77646 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:32.662361 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c6ac9-a88a-40fb-bb0f-f30491c77646 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:32.662636 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c6ac9-a88a-40fb-bb0f-f30491c77646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:32.681291 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-1a9c6ac9-a88a-40fb-bb0f-f30491c77646 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:32.682525 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-1a9c6ac9-a88a-40fb-bb0f-f30491c77646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:32.698519 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0eadca-0ebe-46b6-b7be-98535935affd None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:32.728588 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:32.741174 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73ecae-5f7e-4999-b76c-82ca76b13301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:32.742073 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73ecae-5f7e-4999-b76c-82ca76b13301 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:32.742353 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73ecae-5f7e-4999-b76c-82ca76b13301 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:32.742626 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73ecae-5f7e-4999-b76c-82ca76b13301 None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:32.743288 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73ecae-5f7e-4999-b76c-82ca76b13301 None admin] RBAC: Adding query filter params (name=service) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:32.743587 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73ecae-5f7e-4999-b76c-82ca76b13301 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:32.745954 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73ecae-5f7e-4999-b76c-82ca76b13301 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:32.754260 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 244/484] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 11:49:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:32.755033 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73ecae-5f7e-4999-b76c-82ca76b13301 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:32.763651 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 241/485] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 11:49:32.764516 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c6ac9-a88a-40fb-bb0f-f30491c77646 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:32.832482 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:32.875090 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c6ac9-a88a-40fb-bb0f-f30491c77646 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:32.882595 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73ecae-5f7e-4999-b76c-82ca76b13301 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:32.912304 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60e9b8-4a78-4371-bb1f-9986e6ff34b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:32.912928 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60e9b8-4a78-4371-bb1f-9986e6ff34b4 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:32.913196 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60e9b8-4a78-4371-bb1f-9986e6ff34b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:32.913500 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60e9b8-4a78-4371-bb1f-9986e6ff34b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:32.923207 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e16a5-373f-400a-a36b-a1ea330ea771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:32.923512 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e16a5-373f-400a-a36b-a1ea330ea771 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:32.923790 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e16a5-373f-400a-a36b-a1ea330ea771 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:32.924089 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e16a5-373f-400a-a36b-a1ea330ea771 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:32.926193 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f60e9b8-4a78-4371-bb1f-9986e6ff34b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:32.927632 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f60e9b8-4a78-4371-bb1f-9986e6ff34b4 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:32.937591 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e16a5-373f-400a-a36b-a1ea330ea771 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:32.943748 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-db5e16a5-373f-400a-a36b-a1ea330ea771 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 11:49:32.943748 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:32.943748 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:32.943748 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:32.943748 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:32.943748 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:32.943748 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:32.943748 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:32.943748 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:32.943748 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:32.943748 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:32.943748 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:32.943748 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:32.943748 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:32.943748 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:32.943748 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:32.944678 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:32.944678 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:32.944678 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:32.944678 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:32.944678 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:32.944678 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:32.944678 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:32.944678 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:32.944678 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:32.944678 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:32.944678 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:32.944678 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:32.944678 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:32.944678 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:32.944678 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:32.944678 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:32.945493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:32.945493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:32.945493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:32.945493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:32.945493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:32.945493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:32.945493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:32.945493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:32.945493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:32.945493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:32.945493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 11:49:32.945493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:32.945493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 245/486] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 11:49:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:32.946212 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-4f60e9b8-4a78-4371-bb1f-9986e6ff34b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:32.946212 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:32.946212 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:32.946212 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:32.946212 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:32.946212 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:32.946212 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:32.946212 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:32.946212 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:32.946212 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:32.946212 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:32.946212 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:32.946212 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:49:32.946212 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:49:32.946212 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:49:32.946212 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:49:32.947056 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:32.947056 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:32.947056 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:32.947056 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:32.947056 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:32.947056 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:32.947056 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:32.947056 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:32.947056 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:32.947056 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:32.947056 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:32.947056 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:32.947056 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:32.947056 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:32.947056 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:32.947056 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:32.947056 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:49:32.948576 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:49:32.948576 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:32.948576 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:32.948576 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 242/487] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:32.950545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e16a5-373f-400a-a36b-a1ea330ea771 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:32.953154 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60e9b8-4a78-4371-bb1f-9986e6ff34b4 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:32.999215 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:33.056186 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e16a5-373f-400a-a36b-a1ea330ea771 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:33.060825 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60e9b8-4a78-4371-bb1f-9986e6ff34b4 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:33.070760 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:33.094172 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64191a05-4aa5-40fa-b9ca-211a96e923fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:33.094799 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64191a05-4aa5-40fa-b9ca-211a96e923fa None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:33.094913 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0d4d3-8fb5-4399-ac33-6d06b54587e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:33.095072 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64191a05-4aa5-40fa-b9ca-211a96e923fa None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:33.095337 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64191a05-4aa5-40fa-b9ca-211a96e923fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:33.095513 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0d4d3-8fb5-4399-ac33-6d06b54587e1 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:33.095788 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0d4d3-8fb5-4399-ac33-6d06b54587e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:33.096091 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0d4d3-8fb5-4399-ac33-6d06b54587e1 None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:33.096747 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0d4d3-8fb5-4399-ac33-6d06b54587e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:33.097052 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0d4d3-8fb5-4399-ac33-6d06b54587e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:33.098405 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0d4d3-8fb5-4399-ac33-6d06b54587e1 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:33.105753 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64191a05-4aa5-40fa-b9ca-211a96e923fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:33.106823 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 243/488] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 11:49:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:49:33.111378 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0d4d3-8fb5-4399-ac33-6d06b54587e1 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:33.111469 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-64191a05-4aa5-40fa-b9ca-211a96e923fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 11:49:33.111469 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:33.111469 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:33.111469 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:33.111469 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:33.111469 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:33.111469 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:33.111469 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:33.111469 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:33.111469 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:33.111469 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:33.111469 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:33.111469 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:33.111469 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:33.111469 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:33.111469 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:33.112592 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:33.112592 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:33.112592 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:33.112592 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:33.112592 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:33.112592 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:33.112592 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:33.112592 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:33.112592 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:33.112592 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:33.112592 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:33.112592 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:33.112592 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:33.112592 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:33.112592 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:33.112592 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:33.113596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:33.113596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:33.113596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:33.113596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:33.113596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:33.113596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:33.113596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:33.113596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:33.113596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:33.113596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:33.113596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 11:49:33.113596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:33.113596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 246/489] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 11:49:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:33.113596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64191a05-4aa5-40fa-b9ca-211a96e923fa None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:33.209606 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0d4d3-8fb5-4399-ac33-6d06b54587e1 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:33.209892 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64191a05-4aa5-40fa-b9ca-211a96e923fa None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:33.216656 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:33.244372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be29c42-34cd-4efa-af36-6ee7dd20929f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:33.245597 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be29c42-34cd-4efa-af36-6ee7dd20929f None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:33.245873 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be29c42-34cd-4efa-af36-6ee7dd20929f None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:33.246138 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be29c42-34cd-4efa-af36-6ee7dd20929f None admin] PATH_INFO: `/v3/domains` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:33.246773 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be29c42-34cd-4efa-af36-6ee7dd20929f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:33.247070 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be29c42-34cd-4efa-af36-6ee7dd20929f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:33.248454 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be29c42-34cd-4efa-af36-6ee7dd20929f None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:33.248986 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010300b-306e-4d85-aa5f-8835e771c889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:33.249599 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010300b-306e-4d85-aa5f-8835e771c889 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:33.249872 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010300b-306e-4d85-aa5f-8835e771c889 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:33.250136 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010300b-306e-4d85-aa5f-8835e771c889 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:33.260142 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 244/490] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:33.260321 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010300b-306e-4d85-aa5f-8835e771c889 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:33.260973 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be29c42-34cd-4efa-af36-6ee7dd20929f None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:33.265490 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-1010300b-306e-4d85-aa5f-8835e771c889 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 11:49:33.265490 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:33.265490 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:33.265490 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:33.265490 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:33.265490 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:33.265490 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:33.265490 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:33.265490 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:33.265490 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:33.265490 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:33.265490 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:33.265490 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:33.265490 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:33.265490 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:33.265490 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:33.266392 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:33.266392 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:33.266392 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:33.266392 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:33.266392 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:33.266392 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:33.266392 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:33.266392 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:33.266392 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:33.266392 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:33.266392 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:33.266392 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:33.266392 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:33.266392 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:33.266392 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:33.266392 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:33.267204 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:33.267204 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:33.267204 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:33.267204 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:33.267204 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:33.267204 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:33.267204 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:33.267204 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:33.267204 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:33.267204 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:33.267204 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 11:49:33.267204 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:33.267204 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 247/491] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 11:49:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:33.267877 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010300b-306e-4d85-aa5f-8835e771c889 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:33.293302 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:33.360564 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be29c42-34cd-4efa-af36-6ee7dd20929f None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:33.365483 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010300b-306e-4d85-aa5f-8835e771c889 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:33.395168 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a132d-45bf-4b30-a640-f53afc4d07e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:33.395784 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a132d-45bf-4b30-a640-f53afc4d07e9 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:33.396093 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a132d-45bf-4b30-a640-f53afc4d07e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:33.396362 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a132d-45bf-4b30-a640-f53afc4d07e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:33.399232 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f1a7d-4100-4791-a71c-233dcd2e4d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:33.399814 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f1a7d-4100-4791-a71c-233dcd2e4d87 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:33.400191 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f1a7d-4100-4791-a71c-233dcd2e4d87 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:33.400465 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f1a7d-4100-4791-a71c-233dcd2e4d87 None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:33.401141 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f1a7d-4100-4791-a71c-233dcd2e4d87 None admin] RBAC: Adding query filter params (name=service) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:33.401442 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f1a7d-4100-4791-a71c-233dcd2e4d87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:33.402831 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f1a7d-4100-4791-a71c-233dcd2e4d87 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:33.406100 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a132d-45bf-4b30-a640-f53afc4d07e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:33.407530 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a132d-45bf-4b30-a640-f53afc4d07e9 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:33.410700 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 248/492] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 11:49:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:33.411475 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f1a7d-4100-4791-a71c-233dcd2e4d87 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:33.422733 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-de6a132d-45bf-4b30-a640-f53afc4d07e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:33.422733 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:33.422733 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:33.422733 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:33.422733 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:33.422733 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:33.422733 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:33.422733 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:33.422733 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:33.422733 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:33.422733 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:33.422733 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:33.422733 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:49:33.422733 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:49:33.422733 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:49:33.422733 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:49:33.423737 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:33.423737 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:33.423737 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:33.423737 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:33.423737 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:33.423737 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:33.423737 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:33.423737 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:33.423737 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:33.423737 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:33.423737 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:33.423737 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:33.423737 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:33.423737 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:33.423737 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:33.423737 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:33.423737 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:49:33.424638 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:49:33.424638 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:33.424638 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:33.424638 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 245/493] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:33.424638 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a132d-45bf-4b30-a640-f53afc4d07e9 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:33.444903 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:33.515789 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:33.516358 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f1a7d-4100-4791-a71c-233dcd2e4d87 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:33.532976 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a132d-45bf-4b30-a640-f53afc4d07e9 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:33.549721 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae76436-2835-41a1-a9e6-a0622211701e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:33.550340 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae76436-2835-41a1-a9e6-a0622211701e None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:33.550616 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae76436-2835-41a1-a9e6-a0622211701e None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:33.550885 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae76436-2835-41a1-a9e6-a0622211701e None admin] PATH_INFO: `/v3/users/nova` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:33.558288 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae76436-2835-41a1-a9e6-a0622211701e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:33.559738 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae76436-2835-41a1-a9e6-a0622211701e None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:33.569290 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa28af-3941-4711-aab6-bc0736f727d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:33.569882 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa28af-3941-4711-aab6-bc0736f727d7 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:33.570154 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa28af-3941-4711-aab6-bc0736f727d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:33.570422 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa28af-3941-4711-aab6-bc0736f727d7 None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:33.571076 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa28af-3941-4711-aab6-bc0736f727d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:33.571372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa28af-3941-4711-aab6-bc0736f727d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:33.572460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-6ae76436-2835-41a1-a9e6-a0622211701e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 11:49:33.572460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:33.572460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:33.572460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:33.572460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:33.572460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:33.572460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:33.572460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:33.572460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:33.572460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:33.572460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:33.572460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:33.572460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 11:49:33.572460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 11:49:33.572460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 11:49:33.572460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 11:49:33.573348 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:33.573348 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:33.573348 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 11:49:33.573348 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:49:33.573348 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 11:49:33.573348 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:49:33.573348 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:33.573348 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:33.573348 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:33.573348 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:33.573348 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:33.573348 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:33.573348 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:33.573348 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:33.573348 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:33.573348 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:33.573348 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:33.573348 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:33.574259 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:33.574259 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:33.574259 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 11:49:33.574259 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 11:49:33.574259 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 11:49:33.574259 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 11:49:33.574259 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 11:49:33.574259 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 11:49:33.574259 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 11:49:33.574259 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:33.574766 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa28af-3941-4711-aab6-bc0736f727d7 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:33.574833 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 249/494] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Sep 21 11:49:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:33.574833 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae76436-2835-41a1-a9e6-a0622211701e None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:33.587326 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 246/495] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 11:49:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:33.587326 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa28af-3941-4711-aab6-bc0736f727d7 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:33.670454 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:33.683566 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae76436-2835-41a1-a9e6-a0622211701e None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:33.692690 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa28af-3941-4711-aab6-bc0736f727d7 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:33.716199 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdad9c5-c521-430d-a152-993db6b8533f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:33.716809 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdad9c5-c521-430d-a152-993db6b8533f None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:33.717079 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdad9c5-c521-430d-a152-993db6b8533f None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:33.717346 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdad9c5-c521-430d-a152-993db6b8533f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:33.725632 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230f212-7f9a-45d2-a8f6-c95482dadf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:33.726223 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230f212-7f9a-45d2-a8f6-c95482dadf66 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:33.726497 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230f212-7f9a-45d2-a8f6-c95482dadf66 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:33.726765 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230f212-7f9a-45d2-a8f6-c95482dadf66 None admin] PATH_INFO: `/v3/domains` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:33.727394 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a230f212-7f9a-45d2-a8f6-c95482dadf66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:33.727507 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdad9c5-c521-430d-a152-993db6b8533f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:33.727689 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a230f212-7f9a-45d2-a8f6-c95482dadf66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:33.728989 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdad9c5-c521-430d-a152-993db6b8533f None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:33.729084 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a230f212-7f9a-45d2-a8f6-c95482dadf66 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:33.740512 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 247/496] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:33.741283 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230f212-7f9a-45d2-a8f6-c95482dadf66 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:33.742632 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-bfdad9c5-c521-430d-a152-993db6b8533f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:33.742632 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:33.742632 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:33.742632 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:33.742632 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:33.742632 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:33.742632 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:33.742632 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:33.742632 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:33.742632 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:33.742632 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:33.742632 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:33.742632 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:49:33.742632 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:49:33.742632 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:49:33.742632 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:49:33.743471 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:33.743471 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:33.743471 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:33.743471 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:33.743471 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:33.743471 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:33.743471 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:33.743471 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:33.743471 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:33.743471 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:33.743471 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:33.743471 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:33.743471 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:33.743471 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:33.743471 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:33.743471 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:33.743471 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:49:33.744383 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:49:33.744383 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:33.744383 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:33.744383 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 250/497] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:33.745129 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdad9c5-c521-430d-a152-993db6b8533f None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:33.754759 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:33.845102 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdad9c5-c521-430d-a152-993db6b8533f None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:33.845352 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230f212-7f9a-45d2-a8f6-c95482dadf66 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:33.878501 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e4887-6c5a-4d71-be7c-fcdbe00f00d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:33.879109 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e4887-6c5a-4d71-be7c-fcdbe00f00d3 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:33.879383 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e4887-6c5a-4d71-be7c-fcdbe00f00d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:33.879614 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e6e17-c317-4e0a-92fa-1e36466f14fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:33.879716 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e4887-6c5a-4d71-be7c-fcdbe00f00d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:33.880300 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e6e17-c317-4e0a-92fa-1e36466f14fb None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:33.880572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e6e17-c317-4e0a-92fa-1e36466f14fb None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:33.880836 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e6e17-c317-4e0a-92fa-1e36466f14fb None admin] PATH_INFO: `/v3/users` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:33.881540 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e6e17-c317-4e0a-92fa-1e36466f14fb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:33.881834 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e6e17-c317-4e0a-92fa-1e36466f14fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:33.883252 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e6e17-c317-4e0a-92fa-1e36466f14fb None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:33.888121 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:33.890482 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e4887-6c5a-4d71-be7c-fcdbe00f00d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:33.892545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e4887-6c5a-4d71-be7c-fcdbe00f00d3 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:33.906916 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-bf7e4887-6c5a-4d71-be7c-fcdbe00f00d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:33.906916 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:33.906916 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:33.906916 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:33.906916 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:33.906916 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:33.906916 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:33.906916 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:33.906916 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:33.906916 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:33.906916 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:33.906916 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:33.906916 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:49:33.906916 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:49:33.906916 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:49:33.906916 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:49:33.907838 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:33.907838 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:33.907838 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:33.907838 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:33.907838 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:33.907838 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:33.907838 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:33.907838 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:33.907838 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:33.907838 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:33.907838 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:33.907838 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:33.907838 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:33.907838 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:33.907838 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:33.907838 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:33.907838 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:49:33.908718 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:49:33.908718 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:33.908718 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:33.908718 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 251/498] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:33.908943 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e4887-6c5a-4d71-be7c-fcdbe00f00d3 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:33.921668 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 248/499] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Sep 21 11:49:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:33.922425 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e6e17-c317-4e0a-92fa-1e36466f14fb None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:33.986380 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:34.015330 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e4887-6c5a-4d71-be7c-fcdbe00f00d3 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:34.026746 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e6e17-c317-4e0a-92fa-1e36466f14fb None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:34.048774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b015c-7f10-4ece-abdd-07791f6fac38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:34.049417 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b015c-7f10-4ece-abdd-07791f6fac38 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:34.049691 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b015c-7f10-4ece-abdd-07791f6fac38 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:34.049954 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b015c-7f10-4ece-abdd-07791f6fac38 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:34.057885 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b015c-7f10-4ece-abdd-07791f6fac38 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:34.059334 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b015c-7f10-4ece-abdd-07791f6fac38 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:34.064104 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb9cbe0-dba4-4c5c-b299-bb8ea15d06f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:34.064708 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9cbe0-dba4-4c5c-b299-bb8ea15d06f6 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:34.064992 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9cbe0-dba4-4c5c-b299-bb8ea15d06f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:34.065267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9cbe0-dba4-4c5c-b299-bb8ea15d06f6 None admin] PATH_INFO: `/v3/domains` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:34.065906 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb9cbe0-dba4-4c5c-b299-bb8ea15d06f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:34.066205 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb9cbe0-dba4-4c5c-b299-bb8ea15d06f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:34.067564 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb9cbe0-dba4-4c5c-b299-bb8ea15d06f6 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:34.070640 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-057b015c-7f10-4ece-abdd-07791f6fac38 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 21 11:49:34.070640 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:34.070640 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:34.070640 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:34.070640 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:34.070640 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:34.070640 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:34.070640 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:34.070640 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:34.070640 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:34.070640 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:34.070640 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:34.070640 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 11:49:34.070640 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 11:49:34.070640 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 11:49:34.070640 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 11:49:34.078211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:34.078211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:34.078211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 11:49:34.078211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:49:34.078211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 11:49:34.078211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:49:34.078211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:34.078211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:34.078211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:34.078211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:34.078211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:34.078211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:34.078211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:34.078211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:34.078211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:34.078211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:34.078211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:34.078211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:34.080062 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:34.080062 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:34.080062 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 11:49:34.080062 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 11:49:34.080062 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 11:49:34.080062 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 11:49:34.080062 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 11:49:34.080062 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 11:49:34.080062 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 21 11:49:34.080062 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:34.080062 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 252/500] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:49:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:34.080062 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b015c-7f10-4ece-abdd-07791f6fac38 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:34.083296 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 249/501] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:34.083296 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb9cbe0-dba4-4c5c-b299-bb8ea15d06f6 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:34.132170 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:34.179389 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b015c-7f10-4ece-abdd-07791f6fac38 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:34.179648 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb9cbe0-dba4-4c5c-b299-bb8ea15d06f6 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:34.202801 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:34.212979 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd1249-2184-4569-9492-d26d1d668ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:34.214099 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd1249-2184-4569-9492-d26d1d668ee7 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:34.214373 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd1249-2184-4569-9492-d26d1d668ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:34.214483 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c2d88-1a91-4ead-9910-173456fe44f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:34.214638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd1249-2184-4569-9492-d26d1d668ee7 None admin] PATH_INFO: `/v3/domains` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:34.215045 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c2d88-1a91-4ead-9910-173456fe44f1 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:34.215267 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd1249-2184-4569-9492-d26d1d668ee7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:34.215354 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c2d88-1a91-4ead-9910-173456fe44f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:34.215562 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd1249-2184-4569-9492-d26d1d668ee7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:34.215650 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c2d88-1a91-4ead-9910-173456fe44f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:34.216969 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd1249-2184-4569-9492-d26d1d668ee7 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:34.228322 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 253/502] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:34.229847 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd1249-2184-4569-9492-d26d1d668ee7 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:34.285152 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c2d88-1a91-4ead-9910-173456fe44f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:34.286661 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c2d88-1a91-4ead-9910-173456fe44f1 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:34.326513 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd1249-2184-4569-9492-d26d1d668ee7 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:34.339773 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:34.361484 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a078a0-ddd3-4250-9076-07b61796f122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:34.362080 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a078a0-ddd3-4250-9076-07b61796f122 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:34.362359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a078a0-ddd3-4250-9076-07b61796f122 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:34.362629 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a078a0-ddd3-4250-9076-07b61796f122 None admin] PATH_INFO: `/v3/users` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:34.363347 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a078a0-ddd3-4250-9076-07b61796f122 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:34.363648 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a078a0-ddd3-4250-9076-07b61796f122 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:34.365127 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a078a0-ddd3-4250-9076-07b61796f122 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:34.387394 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 250/503] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:49:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:49:34.388258 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c2d88-1a91-4ead-9910-173456fe44f1 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:34.399964 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 254/504] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Sep 21 11:49:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:34.401325 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a078a0-ddd3-4250-9076-07b61796f122 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:34.412909 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:34.488447 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c2d88-1a91-4ead-9910-173456fe44f1 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:34.499192 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a078a0-ddd3-4250-9076-07b61796f122 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:34.520747 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e7b4b-3c40-426e-bf38-e3ec96dac54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:34.521360 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e7b4b-3c40-426e-bf38-e3ec96dac54e None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:34.521640 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e7b4b-3c40-426e-bf38-e3ec96dac54e None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:34.521912 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e7b4b-3c40-426e-bf38-e3ec96dac54e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:34.529217 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e7b4b-3c40-426e-bf38-e3ec96dac54e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:34.530677 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e7b4b-3c40-426e-bf38-e3ec96dac54e None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:34.532493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970e6d5-d327-4593-9d71-6c0357482769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:34.533126 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970e6d5-d327-4593-9d71-6c0357482769 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:34.533400 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970e6d5-d327-4593-9d71-6c0357482769 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:34.533662 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970e6d5-d327-4593-9d71-6c0357482769 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:34.540350 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970e6d5-d327-4593-9d71-6c0357482769 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:34.542351 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970e6d5-d327-4593-9d71-6c0357482769 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:34.545292 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-008e7b4b-3c40-426e-bf38-e3ec96dac54e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 11:49:34.545292 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:34.545292 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:34.545292 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:34.545292 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:34.545292 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:34.545292 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:34.545292 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:34.545292 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:34.545292 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:34.545292 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:34.545292 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:34.545292 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 11:49:34.545292 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 11:49:34.545292 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 11:49:34.545292 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 11:49:34.546397 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:34.546397 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:34.546397 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 11:49:34.546397 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:49:34.546397 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 11:49:34.546397 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:49:34.546397 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:34.546397 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:34.546397 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:34.546397 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:34.546397 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:34.546397 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:34.546397 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:34.546397 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:34.546397 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:34.546397 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:34.546397 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:34.546397 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:34.547621 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:34.547621 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:34.547621 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 11:49:34.547621 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 11:49:34.547621 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 11:49:34.547621 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 11:49:34.547621 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 11:49:34.547621 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 11:49:34.547621 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 11:49:34.547621 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:34.547621 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 251/505] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:49:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:34.551684 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e7b4b-3c40-426e-bf38-e3ec96dac54e None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:34.553991 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-0970e6d5-d327-4593-9d71-6c0357482769 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 21 11:49:34.553991 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:34.553991 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:34.553991 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:34.553991 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:34.553991 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:34.553991 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:34.553991 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:34.553991 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:34.553991 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:34.553991 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:34.553991 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:34.553991 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 11:49:34.553991 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 11:49:34.553991 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 11:49:34.553991 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 11:49:34.555413 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:34.555413 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:34.555413 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 11:49:34.555413 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:49:34.555413 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 11:49:34.555413 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:49:34.555413 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:34.555413 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:34.555413 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:34.555413 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:34.555413 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:34.555413 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:34.555413 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:34.555413 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:34.555413 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:34.555413 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:34.555413 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:34.555413 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:34.557153 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:34.557153 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:34.557153 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 11:49:34.557153 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 11:49:34.557153 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 11:49:34.557153 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 11:49:34.557153 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 11:49:34.557153 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 11:49:34.557153 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 21 11:49:34.557153 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:34.557153 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 255/506] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 11:49:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:34.557153 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970e6d5-d327-4593-9d71-6c0357482769 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:34.587596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:34.639820 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:34.655958 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e7b4b-3c40-426e-bf38-e3ec96dac54e None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:34.656692 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970e6d5-d327-4593-9d71-6c0357482769 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:34.688277 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa88a8-644c-4a65-ba53-1f4505fee681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:34.688895 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa88a8-644c-4a65-ba53-1f4505fee681 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:34.689001 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff0296-29b5-4825-bacd-40169efc34e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:34.689167 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa88a8-644c-4a65-ba53-1f4505fee681 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:34.689432 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa88a8-644c-4a65-ba53-1f4505fee681 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:34.689589 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff0296-29b5-4825-bacd-40169efc34e4 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:34.689866 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff0296-29b5-4825-bacd-40169efc34e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:34.690137 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff0296-29b5-4825-bacd-40169efc34e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:34.700061 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa88a8-644c-4a65-ba53-1f4505fee681 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:34.701504 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa88a8-644c-4a65-ba53-1f4505fee681 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:34.716331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-92fa88a8-644c-4a65-ba53-1f4505fee681 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:34.716331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:34.716331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:34.716331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:34.716331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:34.716331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:34.716331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:34.716331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:34.716331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:34.716331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:34.716331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:34.716331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:34.716331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:49:34.716331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:49:34.716331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:49:34.716331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:49:34.717224 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:34.717224 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:34.717224 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:34.717224 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:34.717224 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:34.717224 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:34.717224 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:34.717224 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:34.717224 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:34.717224 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:34.717224 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:34.717224 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:34.717224 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:34.717224 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:34.717224 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:34.717224 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:34.717224 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:49:34.718071 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:49:34.718071 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:34.718071 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:34.718071 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 252/507] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:34.718292 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa88a8-644c-4a65-ba53-1f4505fee681 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:34.761860 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff0296-29b5-4825-bacd-40169efc34e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:34.763366 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff0296-29b5-4825-bacd-40169efc34e4 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:34.792712 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:34.818745 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa88a8-644c-4a65-ba53-1f4505fee681 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:34.852534 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e50990-071a-442b-9a7c-bfa184ad1c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:34.853130 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e50990-071a-442b-9a7c-bfa184ad1c7a None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:34.853404 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e50990-071a-442b-9a7c-bfa184ad1c7a None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:34.853672 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e50990-071a-442b-9a7c-bfa184ad1c7a None admin] PATH_INFO: `/v3/users` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:34.854424 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e50990-071a-442b-9a7c-bfa184ad1c7a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:34.854724 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e50990-071a-442b-9a7c-bfa184ad1c7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:34.856170 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e50990-071a-442b-9a7c-bfa184ad1c7a None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:34.858591 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:34.863339 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 256/508] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:49:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:49:34.864392 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff0296-29b5-4825-bacd-40169efc34e4 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:34.882246 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 253/509] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Sep 21 11:49:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:34.882246 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e50990-071a-442b-9a7c-bfa184ad1c7a None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:34.964957 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff0296-29b5-4825-bacd-40169efc34e4 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:34.976556 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e50990-071a-442b-9a7c-bfa184ad1c7a None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:34.992327 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:34.999810 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66bc09-a624-42e1-9776-11340104947c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:35.000454 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66bc09-a624-42e1-9776-11340104947c None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:35.000725 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66bc09-a624-42e1-9776-11340104947c None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:35.000989 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66bc09-a624-42e1-9776-11340104947c None admin] PATH_INFO: `/v3/users` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:35.001695 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66bc09-a624-42e1-9776-11340104947c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:35.001991 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66bc09-a624-42e1-9776-11340104947c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:35.003399 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66bc09-a624-42e1-9776-11340104947c None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:35.011304 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e6141-72e1-46b8-b263-47a22ad78ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:35.011942 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e6141-72e1-46b8-b263-47a22ad78ce6 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:35.012216 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e6141-72e1-46b8-b263-47a22ad78ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:35.012663 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e6141-72e1-46b8-b263-47a22ad78ce6 None admin] PATH_INFO: `/v3/domains` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:35.014226 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e6141-72e1-46b8-b263-47a22ad78ce6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:35.014542 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e6141-72e1-46b8-b263-47a22ad78ce6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:35.015917 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e6141-72e1-46b8-b263-47a22ad78ce6 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:35.021782 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 257/510] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Sep 21 11:49:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:35.022721 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66bc09-a624-42e1-9776-11340104947c None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:35.027412 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 254/511] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:35.028121 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e6141-72e1-46b8-b263-47a22ad78ce6 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:35.082441 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:35.119182 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66bc09-a624-42e1-9776-11340104947c None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:35.125694 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e6141-72e1-46b8-b263-47a22ad78ce6 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:35.152849 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc835eb-9dcb-428b-8864-3f01a141f1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:35.153457 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc835eb-9dcb-428b-8864-3f01a141f1be None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:35.153856 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc835eb-9dcb-428b-8864-3f01a141f1be None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:35.154128 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc835eb-9dcb-428b-8864-3f01a141f1be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:35.158757 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1e027-f4dc-4f4d-a968-eda7d447fd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:35.159355 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1e027-f4dc-4f4d-a968-eda7d447fd5d None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:35.159629 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1e027-f4dc-4f4d-a968-eda7d447fd5d None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:35.159895 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1e027-f4dc-4f4d-a968-eda7d447fd5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:35.164569 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc835eb-9dcb-428b-8864-3f01a141f1be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:35.166007 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc835eb-9dcb-428b-8864-3f01a141f1be None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:35.180636 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-9fc835eb-9dcb-428b-8864-3f01a141f1be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:35.180636 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:35.180636 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:35.180636 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:35.180636 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:35.180636 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:35.180636 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:35.180636 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:35.180636 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:35.180636 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:35.180636 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:35.180636 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:35.180636 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:49:35.180636 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:49:35.180636 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:49:35.180636 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:49:35.181563 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:35.181563 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:35.181563 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:35.181563 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:35.181563 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:35.181563 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:35.181563 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:35.181563 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:35.181563 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:35.181563 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:35.181563 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:35.181563 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:35.181563 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:35.181563 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:35.181563 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:35.181563 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:35.181563 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:49:35.182948 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:49:35.182948 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:35.182948 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:35.182948 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 258/512] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:35.182948 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc835eb-9dcb-428b-8864-3f01a141f1be None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:35.223174 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:35.231286 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1e027-f4dc-4f4d-a968-eda7d447fd5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:35.232779 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1e027-f4dc-4f4d-a968-eda7d447fd5d None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:35.281464 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc835eb-9dcb-428b-8864-3f01a141f1be None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:35.285228 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:35.314721 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cface5-5c64-42f0-8396-236eaa681f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:35.315310 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cface5-5c64-42f0-8396-236eaa681f22 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:35.315587 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cface5-5c64-42f0-8396-236eaa681f22 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:35.315858 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cface5-5c64-42f0-8396-236eaa681f22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:35.331480 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 255/513] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:49:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:49:35.332336 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1e027-f4dc-4f4d-a968-eda7d447fd5d None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:35.385209 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cface5-5c64-42f0-8396-236eaa681f22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:35.386673 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cface5-5c64-42f0-8396-236eaa681f22 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:35.430471 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:35.434626 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1e027-f4dc-4f4d-a968-eda7d447fd5d None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:35.468979 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975290d-8d06-4643-8f92-74bf37cbeddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:35.469583 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975290d-8d06-4643-8f92-74bf37cbeddb None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:35.469855 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975290d-8d06-4643-8f92-74bf37cbeddb None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:35.470120 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975290d-8d06-4643-8f92-74bf37cbeddb None admin] PATH_INFO: `/v3/projects/service` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:35.476761 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975290d-8d06-4643-8f92-74bf37cbeddb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:35.478198 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975290d-8d06-4643-8f92-74bf37cbeddb None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:35.489942 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 259/514] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:49:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:49:35.490711 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-9975290d-8d06-4643-8f92-74bf37cbeddb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:49:35.490711 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:35.490711 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:35.490711 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:35.490711 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:35.490711 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:35.490711 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:35.490711 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:35.490711 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:35.490711 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:35.490711 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:35.490711 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:35.490711 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 11:49:35.490711 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 11:49:35.490711 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 11:49:35.491536 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 11:49:35.491536 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:35.491536 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:35.491536 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:35.491536 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:35.491536 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:35.491536 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:35.491536 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:35.491536 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:35.491536 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:35.491536 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:35.491536 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:35.491536 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:35.491536 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:35.491536 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:35.491536 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:35.491536 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:35.492446 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 11:49:35.492446 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 11:49:35.492446 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 11:49:35.492446 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 11:49:35.492446 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 11:49:35.492446 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 11:49:35.492446 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:49:35.492446 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:35.492874 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cface5-5c64-42f0-8396-236eaa681f22 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:35.492943 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 256/515] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:49:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:35.492943 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975290d-8d06-4643-8f92-74bf37cbeddb None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:35.509879 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:35.594492 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cface5-5c64-42f0-8396-236eaa681f22 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:35.596062 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975290d-8d06-4643-8f92-74bf37cbeddb None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:35.629024 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b8585-91eb-4e91-8d75-47d0975ea9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:35.629232 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b235e0b-723d-4349-9a06-956ccaf64d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:35.629640 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b8585-91eb-4e91-8d75-47d0975ea9c4 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:35.629732 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b235e0b-723d-4349-9a06-956ccaf64d06 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:35.629915 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b8585-91eb-4e91-8d75-47d0975ea9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:35.630013 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b235e0b-723d-4349-9a06-956ccaf64d06 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:35.630184 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b8585-91eb-4e91-8d75-47d0975ea9c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:35.630271 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b235e0b-723d-4349-9a06-956ccaf64d06 None admin] PATH_INFO: `/v3/domains` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:35.630810 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b235e0b-723d-4349-9a06-956ccaf64d06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:35.631102 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b235e0b-723d-4349-9a06-956ccaf64d06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:35.632516 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b235e0b-723d-4349-9a06-956ccaf64d06 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:35.641036 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:35.641217 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b8585-91eb-4e91-8d75-47d0975ea9c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:35.642642 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b8585-91eb-4e91-8d75-47d0975ea9c4 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:35.648138 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 260/516] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:35.648961 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b235e0b-723d-4349-9a06-956ccaf64d06 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:35.658509 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-2e8b8585-91eb-4e91-8d75-47d0975ea9c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:35.658509 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:35.658509 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:35.658509 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:35.658509 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:35.658509 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:35.658509 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:35.658509 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:35.658509 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:35.658509 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:35.658509 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:35.658509 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:35.658509 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:49:35.658509 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:49:35.658509 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:49:35.658509 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:49:35.659449 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:35.659449 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:35.659449 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:35.659449 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:35.659449 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:35.659449 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:35.659449 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:35.659449 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:35.659449 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:35.659449 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:35.659449 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:35.659449 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:35.659449 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:35.659449 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:35.659449 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:35.659449 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:35.659449 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:49:35.660389 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:49:35.660389 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:35.660389 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:35.660389 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 257/517] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:35.660606 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b8585-91eb-4e91-8d75-47d0975ea9c4 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:35.724759 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:35.748369 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b235e0b-723d-4349-9a06-956ccaf64d06 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:35.759605 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b8585-91eb-4e91-8d75-47d0975ea9c4 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:35.781253 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c3a2e-ff4e-41c9-8f7d-125ee06effba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:35.781871 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c3a2e-ff4e-41c9-8f7d-125ee06effba None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:35.782144 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c3a2e-ff4e-41c9-8f7d-125ee06effba None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:35.782418 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c3a2e-ff4e-41c9-8f7d-125ee06effba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:35.792910 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c3a2e-ff4e-41c9-8f7d-125ee06effba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:35.794102 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea0c4e-1099-485a-9da6-9d7cb8e6b6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:35.794358 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c3a2e-ff4e-41c9-8f7d-125ee06effba None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:35.794823 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea0c4e-1099-485a-9da6-9d7cb8e6b6b5 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:35.795101 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea0c4e-1099-485a-9da6-9d7cb8e6b6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:35.795370 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea0c4e-1099-485a-9da6-9d7cb8e6b6b5 None admin] PATH_INFO: `/v3/projects` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:35.796077 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea0c4e-1099-485a-9da6-9d7cb8e6b6b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:35.796379 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea0c4e-1099-485a-9da6-9d7cb8e6b6b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:35.797783 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea0c4e-1099-485a-9da6-9d7cb8e6b6b5 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:35.808507 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-074c3a2e-ff4e-41c9-8f7d-125ee06effba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:35.808507 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:35.808507 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:35.808507 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:35.808507 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:35.808507 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:35.808507 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:35.808507 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:35.808507 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:35.808507 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:35.808507 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:35.808507 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:35.808507 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:49:35.808507 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:49:35.808507 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:49:35.808507 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:49:35.809493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:35.809493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:35.809493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:35.809493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:35.809493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:35.809493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:35.809493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:35.809493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:35.809493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:35.809493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:35.809493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:35.809493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:35.809493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:35.809493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:35.809493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:35.809493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:35.809493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:49:35.810496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:49:35.810496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:35.810496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:35.810496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 261/518] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:35.810496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c3a2e-ff4e-41c9-8f7d-125ee06effba None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:35.824443 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 258/519] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 11:49:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:35.824443 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea0c4e-1099-485a-9da6-9d7cb8e6b6b5 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:35.867626 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:35.913624 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c3a2e-ff4e-41c9-8f7d-125ee06effba None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:35.920461 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea0c4e-1099-485a-9da6-9d7cb8e6b6b5 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:35.946258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ad96d-c517-4f92-8535-b45842237d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:35.946863 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ad96d-c517-4f92-8535-b45842237d1f None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:35.947135 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ad96d-c517-4f92-8535-b45842237d1f None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:35.947332 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:35.947424 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ad96d-c517-4f92-8535-b45842237d1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:35.954367 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ad96d-c517-4f92-8535-b45842237d1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:35.955785 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ad96d-c517-4f92-8535-b45842237d1f None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:35.957232 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9c56a-270e-4373-bd2f-4cc5c9d24c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:35.957857 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9c56a-270e-4373-bd2f-4cc5c9d24c19 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:35.958129 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9c56a-270e-4373-bd2f-4cc5c9d24c19 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:35.958396 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9c56a-270e-4373-bd2f-4cc5c9d24c19 None admin] PATH_INFO: `/v3/domains` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:35.959025 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9c56a-270e-4373-bd2f-4cc5c9d24c19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:35.959318 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9c56a-270e-4373-bd2f-4cc5c9d24c19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:35.960689 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9c56a-270e-4373-bd2f-4cc5c9d24c19 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:35.967573 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-0c2ad96d-c517-4f92-8535-b45842237d1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:49:35.967573 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:35.967573 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:35.967573 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:35.967573 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:35.967573 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:35.967573 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:35.967573 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:35.967573 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:35.967573 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:35.967573 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:35.967573 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:35.967573 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 11:49:35.967573 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 11:49:35.967573 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 11:49:35.968601 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 11:49:35.968601 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:35.968601 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:35.968601 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:35.968601 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:35.968601 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:35.968601 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:35.968601 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:35.968601 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:35.968601 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:35.968601 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:35.968601 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:35.968601 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:35.968601 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:35.968601 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:35.968601 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:35.968601 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:35.969455 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 11:49:35.969455 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 11:49:35.969455 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 11:49:35.969455 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 11:49:35.969455 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 11:49:35.969455 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 11:49:35.969455 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:49:35.969455 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:35.969455 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 262/520] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:49:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:35.969455 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ad96d-c517-4f92-8535-b45842237d1f None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:35.974226 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 259/521] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:35.975044 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9c56a-270e-4373-bd2f-4cc5c9d24c19 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:36.088571 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9c56a-270e-4373-bd2f-4cc5c9d24c19 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:36.089706 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ad96d-c517-4f92-8535-b45842237d1f None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:36.101802 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:36.122214 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d3d79-b8bb-4039-9568-065f885f1630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:36.122764 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d3d79-b8bb-4039-9568-065f885f1630 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:36.123005 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d3d79-b8bb-4039-9568-065f885f1630 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:36.123269 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d3d79-b8bb-4039-9568-065f885f1630 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:36.123845 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc6506-0c3d-43ae-8787-4852b98f7c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:36.124035 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d3d79-b8bb-4039-9568-065f885f1630 None admin] RBAC: Adding query filter params (role.id=1557d254ce394d9e8d83e9c55cc20445, scope.project.id=1fd87b195f7c46d2a0d621124acce331, user.id=c683dcd33e5b40fabbbf12c3dcf97eb1) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:36.124300 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d3d79-b8bb-4039-9568-065f885f1630 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:36.124454 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc6506-0c3d-43ae-8787-4852b98f7c1a None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:36.124727 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc6506-0c3d-43ae-8787-4852b98f7c1a None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:36.124988 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc6506-0c3d-43ae-8787-4852b98f7c1a None admin] PATH_INFO: `/v3/domains` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:36.125612 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc6506-0c3d-43ae-8787-4852b98f7c1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:36.125698 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d3d79-b8bb-4039-9568-065f885f1630 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:36.125904 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc6506-0c3d-43ae-8787-4852b98f7c1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:36.127319 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc6506-0c3d-43ae-8787-4852b98f7c1a None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:36.130912 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 260/522] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 11:49:35 2022] GET /identity/v3/role_assignments?user.id=c683dcd33e5b40fabbbf12c3dcf97eb1&scope.project.id=1fd87b195f7c46d2a0d621124acce331&role.id=1557d254ce394d9e8d83e9c55cc20445 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:36.131669 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d3d79-b8bb-4039-9568-065f885f1630 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:36.139570 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 263/523] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:36.140472 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc6506-0c3d-43ae-8787-4852b98f7c1a None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:36.203462 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:36.256959 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc6506-0c3d-43ae-8787-4852b98f7c1a None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:36.262984 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d3d79-b8bb-4039-9568-065f885f1630 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:36.293803 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391de4e-9bad-4ea6-a044-eb3d44997036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:36.294423 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391de4e-9bad-4ea6-a044-eb3d44997036 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:36.294697 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391de4e-9bad-4ea6-a044-eb3d44997036 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:36.294963 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391de4e-9bad-4ea6-a044-eb3d44997036 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:36.302170 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e7eac-c530-45b3-bbac-0adffdd6ca2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:36.302391 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391de4e-9bad-4ea6-a044-eb3d44997036 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:36.302788 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e7eac-c530-45b3-bbac-0adffdd6ca2b None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:36.303067 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e7eac-c530-45b3-bbac-0adffdd6ca2b None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:36.303338 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e7eac-c530-45b3-bbac-0adffdd6ca2b None admin] PATH_INFO: `/v3/projects` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:36.303851 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391de4e-9bad-4ea6-a044-eb3d44997036 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:36.304060 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e7eac-c530-45b3-bbac-0adffdd6ca2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:36.304400 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e7eac-c530-45b3-bbac-0adffdd6ca2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:36.306036 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e7eac-c530-45b3-bbac-0adffdd6ca2b None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:36.316676 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-d391de4e-9bad-4ea6-a044-eb3d44997036 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:49:36.316676 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:36.316676 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:36.316676 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:36.316676 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:36.316676 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:36.316676 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:36.316676 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:36.316676 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:36.316676 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:36.316676 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:36.316676 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:36.316676 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 11:49:36.316676 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 11:49:36.316676 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 11:49:36.317622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 11:49:36.317622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:36.317622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:36.317622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:36.317622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:36.317622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:36.317622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:36.317622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:36.317622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:36.317622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:36.317622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:36.317622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:36.317622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:36.317622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:36.317622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:36.317622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:36.317622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:36.318487 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 11:49:36.318487 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 11:49:36.318487 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 11:49:36.318487 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 11:49:36.318487 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 11:49:36.318487 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 11:49:36.318487 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:49:36.318487 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:36.318487 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 264/524] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:49:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:36.318955 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391de4e-9bad-4ea6-a044-eb3d44997036 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:36.332141 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 261/525] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 11:49:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:36.332141 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e7eac-c530-45b3-bbac-0adffdd6ca2b None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:36.355090 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:36.425932 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391de4e-9bad-4ea6-a044-eb3d44997036 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:36.457621 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e7eac-c530-45b3-bbac-0adffdd6ca2b None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:36.459806 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d53944-cc83-45b8-8d73-f6a79f0aa155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:36.460462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d53944-cc83-45b8-8d73-f6a79f0aa155 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:36.460730 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d53944-cc83-45b8-8d73-f6a79f0aa155 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:36.461003 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d53944-cc83-45b8-8d73-f6a79f0aa155 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:36.468221 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d53944-cc83-45b8-8d73-f6a79f0aa155 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:36.469665 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d53944-cc83-45b8-8d73-f6a79f0aa155 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:36.469805 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:36.483404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-18d53944-cc83-45b8-8d73-f6a79f0aa155 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:49:36.483404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:36.483404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:36.483404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:36.483404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:36.483404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:36.483404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:36.483404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:36.483404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:36.483404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:36.483404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:36.483404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:36.483404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 11:49:36.483404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 11:49:36.483404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 11:49:36.484460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 11:49:36.484460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:36.484460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:36.484460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:36.484460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:36.484460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:36.484460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:36.484460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:36.484460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:36.484460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:36.484460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:36.484460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:36.484460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:36.484460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:36.484460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:36.484460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:36.484460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:36.485322 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 11:49:36.485322 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 11:49:36.485322 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 11:49:36.485322 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 11:49:36.485322 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 11:49:36.485322 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 11:49:36.485322 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:49:36.485322 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:36.485322 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 265/526] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:49:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:36.487764 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d53944-cc83-45b8-8d73-f6a79f0aa155 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:36.497392 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f840f30-90cb-4c38-a3e6-82411a0f7ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:36.497988 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f840f30-90cb-4c38-a3e6-82411a0f7ab3 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:36.498256 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f840f30-90cb-4c38-a3e6-82411a0f7ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:36.498518 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f840f30-90cb-4c38-a3e6-82411a0f7ab3 None admin] PATH_INFO: `/v3/projects` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:36.499252 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f840f30-90cb-4c38-a3e6-82411a0f7ab3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:36.499557 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f840f30-90cb-4c38-a3e6-82411a0f7ab3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:36.501105 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f840f30-90cb-4c38-a3e6-82411a0f7ab3 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:36.512864 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 262/527] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 11:49:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:36.512864 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f840f30-90cb-4c38-a3e6-82411a0f7ab3 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:36.590928 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:36.599952 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d53944-cc83-45b8-8d73-f6a79f0aa155 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:36.630932 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f840f30-90cb-4c38-a3e6-82411a0f7ab3 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:36.634641 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a98885-62b8-4d19-ac46-0a74ed34b4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:36.635331 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a98885-62b8-4d19-ac46-0a74ed34b4e0 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:36.635608 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a98885-62b8-4d19-ac46-0a74ed34b4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:36.635874 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a98885-62b8-4d19-ac46-0a74ed34b4e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:36.636619 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a98885-62b8-4d19-ac46-0a74ed34b4e0 None admin] RBAC: Adding query filter params (role.id=1557d254ce394d9e8d83e9c55cc20445, scope.project.id=1fd87b195f7c46d2a0d621124acce331, user.id=f4e6b7bc6eea49ba9f54b0305f3173b0) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:36.636923 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a98885-62b8-4d19-ac46-0a74ed34b4e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:36.638407 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a98885-62b8-4d19-ac46-0a74ed34b4e0 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:36.643845 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 266/528] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 11:49:36 2022] GET /identity/v3/role_assignments?user.id=f4e6b7bc6eea49ba9f54b0305f3173b0&scope.project.id=1fd87b195f7c46d2a0d621124acce331&role.id=1557d254ce394d9e8d83e9c55cc20445 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:36.644689 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a98885-62b8-4d19-ac46-0a74ed34b4e0 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:36.680784 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f1c2a-9b28-4bba-a683-84c8e478edb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:36.681949 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f1c2a-9b28-4bba-a683-84c8e478edb7 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:36.682478 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f1c2a-9b28-4bba-a683-84c8e478edb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:36.682944 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f1c2a-9b28-4bba-a683-84c8e478edb7 None admin] PATH_INFO: `/v3/projects` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:36.683803 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f1c2a-9b28-4bba-a683-84c8e478edb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:36.684275 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f1c2a-9b28-4bba-a683-84c8e478edb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:36.686329 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f1c2a-9b28-4bba-a683-84c8e478edb7 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:36.702058 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 263/529] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 11:49:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:36.708954 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f1c2a-9b28-4bba-a683-84c8e478edb7 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:36.756338 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:36.783684 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a98885-62b8-4d19-ac46-0a74ed34b4e0 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:36.828023 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70b9f5-099c-4fb3-8b8d-505784bd0b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:36.835634 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70b9f5-099c-4fb3-8b8d-505784bd0b24 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:36.836309 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70b9f5-099c-4fb3-8b8d-505784bd0b24 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:36.837225 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70b9f5-099c-4fb3-8b8d-505784bd0b24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:36.839063 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70b9f5-099c-4fb3-8b8d-505784bd0b24 None admin] RBAC: Adding query filter params (role.id=1557d254ce394d9e8d83e9c55cc20445, scope.project.id=1fd87b195f7c46d2a0d621124acce331, user.id=75426336bd2d443fbe3f2dd97293fc15) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:36.839627 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70b9f5-099c-4fb3-8b8d-505784bd0b24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:36.842312 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70b9f5-099c-4fb3-8b8d-505784bd0b24 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:36.850506 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 267/530] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 11:49:36 2022] GET /identity/v3/role_assignments?user.id=75426336bd2d443fbe3f2dd97293fc15&scope.project.id=1fd87b195f7c46d2a0d621124acce331&role.id=1557d254ce394d9e8d83e9c55cc20445 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:36.868344 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f1c2a-9b28-4bba-a683-84c8e478edb7 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:36.912302 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76162e6c-d00f-4278-ba93-b99d7d034cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:36.912915 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76162e6c-d00f-4278-ba93-b99d7d034cf9 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:36.913192 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76162e6c-d00f-4278-ba93-b99d7d034cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:36.913455 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76162e6c-d00f-4278-ba93-b99d7d034cf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:36.914259 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76162e6c-d00f-4278-ba93-b99d7d034cf9 None admin] RBAC: Adding query filter params (role.id=1557d254ce394d9e8d83e9c55cc20445, scope.project.id=1fd87b195f7c46d2a0d621124acce331, user.id=1cf371d784014c68a9ff4c301dad5ca9) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:36.914565 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76162e6c-d00f-4278-ba93-b99d7d034cf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:36.916201 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76162e6c-d00f-4278-ba93-b99d7d034cf9 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:36.923379 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 264/531] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 11:49:36 2022] GET /identity/v3/role_assignments?user.id=1cf371d784014c68a9ff4c301dad5ca9&scope.project.id=1fd87b195f7c46d2a0d621124acce331&role.id=1557d254ce394d9e8d83e9c55cc20445 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:38.572959 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70ca6e-b23c-4e3a-90db-94d454635970 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:38.573506 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70ca6e-b23c-4e3a-90db-94d454635970 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:38.573506 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70ca6e-b23c-4e3a-90db-94d454635970 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:38.575196 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 268/532] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:38.580591 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973b082-f928-47d7-8016-a520367791c1 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:38.581044 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973b082-f928-47d7-8016-a520367791c1 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:38.581141 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973b082-f928-47d7-8016-a520367791c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:38.607244 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-b973b082-f928-47d7-8016-a520367791c1 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:38.608837 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-b973b082-f928-47d7-8016-a520367791c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:38.688351 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 265/533] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 11:49:39.019529 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70ca6e-b23c-4e3a-90db-94d454635970 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:39.044866 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:39.100032 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8df2f4-e1b6-470f-9ed4-8ae881e1a324 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:39.100649 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8df2f4-e1b6-470f-9ed4-8ae881e1a324 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:39.101135 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8df2f4-e1b6-470f-9ed4-8ae881e1a324 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:39.102923 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 266/534] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 11:49:39.108675 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18063f8-cd88-41ca-aa63-fe412fedb7e0 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:39.109200 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18063f8-cd88-41ca-aa63-fe412fedb7e0 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:39.109670 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18063f8-cd88-41ca-aa63-fe412fedb7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:39.128505 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-c18063f8-cd88-41ca-aa63-fe412fedb7e0 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:39.130001 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-c18063f8-cd88-41ca-aa63-fe412fedb7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:39.130935 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70ca6e-b23c-4e3a-90db-94d454635970 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:39.149257 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:39.167376 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdfb3f-e7b7-4aa6-b455-cf31e7e82628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:39.168398 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdfb3f-e7b7-4aa6-b455-cf31e7e82628 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:39.168975 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdfb3f-e7b7-4aa6-b455-cf31e7e82628 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:39.169408 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdfb3f-e7b7-4aa6-b455-cf31e7e82628 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:39.180559 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fdfb3f-e7b7-4aa6-b455-cf31e7e82628 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:39.186628 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-87fdfb3f-e7b7-4aa6-b455-cf31e7e82628 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 11:49:39.186628 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:39.186628 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:39.186628 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:39.186628 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:39.186628 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:39.186628 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:39.186628 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:39.186628 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:39.186628 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:39.186628 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:39.186628 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:39.186628 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:39.186628 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:39.186628 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:39.186628 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:39.187772 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:39.187772 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:39.187772 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:39.187772 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:39.187772 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:39.187772 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:39.187772 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:39.187772 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:39.187772 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:39.187772 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:39.187772 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:39.187772 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:39.187772 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:39.187772 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:39.187772 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:39.187772 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:39.188876 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:39.188876 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:39.188876 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:39.188876 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:39.188876 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:39.188876 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:39.188876 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:39.188876 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:39.188876 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:39.188876 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:39.188876 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 11:49:39.188876 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:39.191101 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 269/535] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 11:49:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:39.196845 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdfb3f-e7b7-4aa6-b455-cf31e7e82628 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:39.212113 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 267/536] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 11:49:39.282173 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:39.302054 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdfb3f-e7b7-4aa6-b455-cf31e7e82628 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:39.314125 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9b7a8-efa4-4e7c-9ff6-ac024f517c0f None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:39.314710 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9b7a8-efa4-4e7c-9ff6-ac024f517c0f None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:39.315284 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9b7a8-efa4-4e7c-9ff6-ac024f517c0f None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:39.316927 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 268/537] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:39.322545 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa64bb6-b2f7-4f59-b173-4fe97c3286dd None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:39.322825 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa64bb6-b2f7-4f59-b173-4fe97c3286dd None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:39.323081 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa64bb6-b2f7-4f59-b173-4fe97c3286dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:39.342309 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-efa64bb6-b2f7-4f59-b173-4fe97c3286dd None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:39.343268 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0412bf-76e4-4f1a-a686-7033280dfc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:39.343865 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0412bf-76e4-4f1a-a686-7033280dfc22 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:39.344178 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0412bf-76e4-4f1a-a686-7033280dfc22 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:39.344447 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0412bf-76e4-4f1a-a686-7033280dfc22 None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:39.344725 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-efa64bb6-b2f7-4f59-b173-4fe97c3286dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:39.345103 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0412bf-76e4-4f1a-a686-7033280dfc22 None admin] RBAC: Adding query filter params (name=service) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:39.345404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0412bf-76e4-4f1a-a686-7033280dfc22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:39.346784 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0412bf-76e4-4f1a-a686-7033280dfc22 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:39.355795 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 270/538] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 11:49:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:39.361831 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0412bf-76e4-4f1a-a686-7033280dfc22 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:39.421041 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 269/539] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:49:39.422853 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555d712-f323-4d49-bf9e-3e6a7c143484 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:39.423669 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555d712-f323-4d49-bf9e-3e6a7c143484 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:39.424467 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555d712-f323-4d49-bf9e-3e6a7c143484 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:39.426170 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 270/540] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:39.430837 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0838b7-dad6-450f-a965-eb3363827e35 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:39.431133 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0838b7-dad6-450f-a965-eb3363827e35 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:39.431957 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0838b7-dad6-450f-a965-eb3363827e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:39.450068 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-5c0838b7-dad6-450f-a965-eb3363827e35 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:39.451473 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-5c0838b7-dad6-450f-a965-eb3363827e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:39.478960 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0412bf-76e4-4f1a-a686-7033280dfc22 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:39.516976 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f024b9-fdff-4fe9-b7db-fbcd4b501757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:39.517731 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f024b9-fdff-4fe9-b7db-fbcd4b501757 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:39.518106 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f024b9-fdff-4fe9-b7db-fbcd4b501757 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:39.518590 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f024b9-fdff-4fe9-b7db-fbcd4b501757 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:39.528355 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 271/541] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 11:49:39.530577 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f024b9-fdff-4fe9-b7db-fbcd4b501757 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:39.532058 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f024b9-fdff-4fe9-b7db-fbcd4b501757 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:39.533908 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:39.544419 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0838b7-dad6-450f-a965-eb3363827e35 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:39.549973 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-78f024b9-fdff-4fe9-b7db-fbcd4b501757 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:39.549973 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:39.549973 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:39.549973 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:39.549973 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:39.549973 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:39.549973 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:39.549973 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:39.549973 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:39.549973 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:39.549973 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:39.549973 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:39.549973 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:49:39.549973 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:49:39.549973 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:49:39.549973 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:49:39.550899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:39.550899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:39.550899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:39.550899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:39.550899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:39.550899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:39.550899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:39.550899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:39.550899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:39.550899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:39.550899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:39.550899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:39.550899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:39.550899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:39.550899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:39.550899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:39.550899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:49:39.551807 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:49:39.551807 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:39.551807 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:39.555911 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 271/542] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:39.557212 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f024b9-fdff-4fe9-b7db-fbcd4b501757 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:39.564072 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:39.678463 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f024b9-fdff-4fe9-b7db-fbcd4b501757 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:39.684824 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0838b7-dad6-450f-a965-eb3363827e35 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:39.723862 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ec8d8-b434-4255-abab-47985d20a8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:39.724691 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b28c3d-979e-4358-9fe1-3f1125c09810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:39.724864 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ec8d8-b434-4255-abab-47985d20a8e2 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:39.725021 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ec8d8-b434-4255-abab-47985d20a8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:39.725441 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ec8d8-b434-4255-abab-47985d20a8e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:39.725604 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b28c3d-979e-4358-9fe1-3f1125c09810 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:39.725882 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b28c3d-979e-4358-9fe1-3f1125c09810 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:39.726150 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b28c3d-979e-4358-9fe1-3f1125c09810 None admin] PATH_INFO: `/v3/domains` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:39.726968 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b28c3d-979e-4358-9fe1-3f1125c09810 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:39.727269 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b28c3d-979e-4358-9fe1-3f1125c09810 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:39.729396 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b28c3d-979e-4358-9fe1-3f1125c09810 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:39.739070 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ec8d8-b434-4255-abab-47985d20a8e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:39.744912 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-5c9ec8d8-b434-4255-abab-47985d20a8e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 11:49:39.744912 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:39.744912 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:39.744912 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:39.744912 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:39.744912 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:39.744912 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:39.744912 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:39.744912 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:39.744912 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:39.744912 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:39.744912 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:39.744912 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:39.744912 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:39.744912 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:39.744912 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:39.746094 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:39.746094 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:39.746094 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:39.746094 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:39.746094 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:39.746094 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:39.746094 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:39.746094 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:39.746094 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:39.746094 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:39.746094 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:39.746094 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:39.746094 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:39.746094 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:39.746094 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:39.746094 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:39.747097 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:39.747097 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:39.747097 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:39.747097 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:39.747097 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:39.747097 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:39.747097 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:39.747097 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:39.747097 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:39.747097 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:39.747097 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 11:49:39.747097 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:39.748059 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 272/543] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:49:39.753640 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b28c3d-979e-4358-9fe1-3f1125c09810 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:39.754106 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 272/544] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 11:49:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 11:49:39.755111 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ec8d8-b434-4255-abab-47985d20a8e2 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:39.807587 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:39.843038 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:39.857552 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b28c3d-979e-4358-9fe1-3f1125c09810 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:39.870013 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ec8d8-b434-4255-abab-47985d20a8e2 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:39.891618 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e0542-2ba9-46ee-958c-324520d1c7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:39.892270 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e0542-2ba9-46ee-958c-324520d1c7a2 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:39.892549 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e0542-2ba9-46ee-958c-324520d1c7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:39.892817 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e0542-2ba9-46ee-958c-324520d1c7a2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:39.899668 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e0542-2ba9-46ee-958c-324520d1c7a2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:39.901735 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e0542-2ba9-46ee-958c-324520d1c7a2 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:39.906220 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a271a-39f3-4389-8f73-a40bd521d940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:39.906809 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a271a-39f3-4389-8f73-a40bd521d940 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:39.907081 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a271a-39f3-4389-8f73-a40bd521d940 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:39.907347 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a271a-39f3-4389-8f73-a40bd521d940 None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:39.908017 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a271a-39f3-4389-8f73-a40bd521d940 None admin] RBAC: Adding query filter params (name=service) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:39.908324 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a271a-39f3-4389-8f73-a40bd521d940 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:39.909661 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a271a-39f3-4389-8f73-a40bd521d940 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:39.914295 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-328e0542-2ba9-46ee-958c-324520d1c7a2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 11:49:39.914295 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:39.914295 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:39.914295 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:39.914295 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:39.914295 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:39.914295 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:39.914295 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:39.914295 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:39.914295 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:39.914295 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:39.914295 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:39.914295 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 11:49:39.914295 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 11:49:39.914295 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 11:49:39.914295 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 11:49:39.915196 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:39.915196 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:39.915196 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 11:49:39.915196 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:49:39.915196 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 11:49:39.915196 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:49:39.915196 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:39.915196 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:39.915196 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:39.915196 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:39.915196 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:39.915196 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:39.915196 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:39.915196 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:39.915196 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:39.915196 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:39.915196 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:39.915196 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:39.916437 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:39.916437 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:39.916437 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 11:49:39.916437 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 11:49:39.916437 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 11:49:39.916437 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 11:49:39.916437 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 11:49:39.916437 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 11:49:39.916437 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 11:49:39.916437 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:39.916437 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 273/545] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Sep 21 11:49:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 11:49:39.917023 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e0542-2ba9-46ee-958c-324520d1c7a2 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:39.922468 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 273/546] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 11:49:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:39.922468 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a271a-39f3-4389-8f73-a40bd521d940 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:40.015101 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e0542-2ba9-46ee-958c-324520d1c7a2 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:40.019551 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a271a-39f3-4389-8f73-a40bd521d940 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:40.029176 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:40.049334 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43c350-d811-4ee2-91d7-095d938cad5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:40.049940 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43c350-d811-4ee2-91d7-095d938cad5c None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:40.050210 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43c350-d811-4ee2-91d7-095d938cad5c None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:40.050476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43c350-d811-4ee2-91d7-095d938cad5c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:40.052636 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfebb3-541f-4cf2-a709-9d8fb0fbf66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:40.053246 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfebb3-541f-4cf2-a709-9d8fb0fbf66f None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:40.053518 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfebb3-541f-4cf2-a709-9d8fb0fbf66f None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:40.053785 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfebb3-541f-4cf2-a709-9d8fb0fbf66f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:40.056314 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:40.060952 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43c350-d811-4ee2-91d7-095d938cad5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:40.064652 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfebb3-541f-4cf2-a709-9d8fb0fbf66f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:40.066020 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-ee43c350-d811-4ee2-91d7-095d938cad5c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 11:49:40.066020 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:40.066020 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:40.066020 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:40.066020 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:40.066020 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:40.066020 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:40.066020 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:40.066020 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:40.066020 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:40.066020 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:40.066020 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:40.066020 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:40.066020 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:40.066020 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:40.066020 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:40.067034 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:40.067034 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:40.067034 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:40.067034 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:40.067034 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:40.067034 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:40.067034 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:40.067034 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:40.067034 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:40.067034 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:40.067034 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:40.067034 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:40.067034 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:40.067034 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:40.067034 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:40.067034 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:40.068083 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:40.068083 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:40.068083 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:40.068083 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:40.068083 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:40.068083 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:40.068083 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:40.068083 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:40.068083 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:40.068083 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:40.068083 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 11:49:40.068083 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:40.069781 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-2acfebb3-541f-4cf2-a709-9d8fb0fbf66f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 11:49:40.069781 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:40.069781 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:40.069781 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:40.069781 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:40.069781 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:40.069781 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:40.069781 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:40.069781 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:40.069781 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:40.069781 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:40.069781 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:40.069781 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:40.069781 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:40.069781 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:40.069781 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:40.070943 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:40.070943 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:40.070943 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:40.070943 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:40.070943 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:40.070943 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:40.070943 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:40.070943 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:40.070943 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:40.070943 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:40.070943 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:40.070943 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:40.070943 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:40.070943 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:40.070943 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:40.070943 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:40.073217 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:40.073217 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:40.073217 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:40.073217 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:40.073217 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:40.073217 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:40.073217 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:40.073217 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:40.073217 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:40.073217 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:40.073217 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 11:49:40.073217 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:40.073217 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 274/547] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 11:49:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:40.074086 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 274/548] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 11:49:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:40.074169 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfebb3-541f-4cf2-a709-9d8fb0fbf66f None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:40.074257 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43c350-d811-4ee2-91d7-095d938cad5c None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:40.172883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43c350-d811-4ee2-91d7-095d938cad5c None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:40.173085 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfebb3-541f-4cf2-a709-9d8fb0fbf66f None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:40.206468 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895c9d9-b184-4f43-b02c-49f2d7009849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:40.207081 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895c9d9-b184-4f43-b02c-49f2d7009849 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:40.207360 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895c9d9-b184-4f43-b02c-49f2d7009849 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:40.207460 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda75eb-91a7-42ce-8fcc-00fca4f8b249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:40.207635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895c9d9-b184-4f43-b02c-49f2d7009849 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:40.208064 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda75eb-91a7-42ce-8fcc-00fca4f8b249 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:40.208353 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda75eb-91a7-42ce-8fcc-00fca4f8b249 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:40.208620 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda75eb-91a7-42ce-8fcc-00fca4f8b249 None admin] PATH_INFO: `/v3/users` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:40.209343 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda75eb-91a7-42ce-8fcc-00fca4f8b249 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:40.209647 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda75eb-91a7-42ce-8fcc-00fca4f8b249 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:40.211072 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda75eb-91a7-42ce-8fcc-00fca4f8b249 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:40.218643 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895c9d9-b184-4f43-b02c-49f2d7009849 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:40.220111 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895c9d9-b184-4f43-b02c-49f2d7009849 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:40.228239 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 275/549] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Sep 21 11:49:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:40.229027 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda75eb-91a7-42ce-8fcc-00fca4f8b249 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:40.233822 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-b895c9d9-b184-4f43-b02c-49f2d7009849 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:40.233822 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:40.233822 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:40.233822 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:40.233822 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:40.233822 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:40.233822 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:40.233822 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:40.233822 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:40.233822 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:40.233822 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:40.233822 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:40.233822 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:49:40.233822 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:49:40.233822 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:49:40.233822 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:49:40.234878 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:40.234878 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:40.234878 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:40.234878 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:40.234878 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:40.234878 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:40.234878 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:40.234878 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:40.234878 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:40.234878 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:40.234878 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:40.234878 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:40.234878 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:40.234878 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:40.234878 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:40.234878 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:40.234878 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:49:40.240600 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:49:40.240600 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:40.240600 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:40.240600 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 275/550] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:40.240600 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895c9d9-b184-4f43-b02c-49f2d7009849 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:40.266500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:40.285854 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:40.329931 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda75eb-91a7-42ce-8fcc-00fca4f8b249 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:40.338447 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895c9d9-b184-4f43-b02c-49f2d7009849 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:40.362738 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b992b5a-9490-4f13-af9f-cbc208b9b585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:40.363377 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b992b5a-9490-4f13-af9f-cbc208b9b585 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:40.363647 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b992b5a-9490-4f13-af9f-cbc208b9b585 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:40.363917 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b992b5a-9490-4f13-af9f-cbc208b9b585 None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:40.364606 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b992b5a-9490-4f13-af9f-cbc208b9b585 None admin] RBAC: Adding query filter params (name=service) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:40.364899 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b992b5a-9490-4f13-af9f-cbc208b9b585 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:40.366320 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b992b5a-9490-4f13-af9f-cbc208b9b585 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:40.372993 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc900c1-05a9-4eec-a3f7-91aa685b70d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:40.373586 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc900c1-05a9-4eec-a3f7-91aa685b70d4 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:40.374027 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc900c1-05a9-4eec-a3f7-91aa685b70d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:40.374230 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc900c1-05a9-4eec-a3f7-91aa685b70d4 None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:40.375445 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc900c1-05a9-4eec-a3f7-91aa685b70d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:40.375445 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc900c1-05a9-4eec-a3f7-91aa685b70d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:40.375624 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 276/551] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 11:49:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:40.376438 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b992b5a-9490-4f13-af9f-cbc208b9b585 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:40.376826 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc900c1-05a9-4eec-a3f7-91aa685b70d4 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:40.386167 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 276/552] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 11:49:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:40.386965 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc900c1-05a9-4eec-a3f7-91aa685b70d4 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:40.477190 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:40.477375 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b992b5a-9490-4f13-af9f-cbc208b9b585 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:40.489738 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc900c1-05a9-4eec-a3f7-91aa685b70d4 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:40.492596 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:40.512447 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2bd6a-9456-4be4-8e3c-4bbbec4be655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:40.513055 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2bd6a-9456-4be4-8e3c-4bbbec4be655 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:40.513329 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2bd6a-9456-4be4-8e3c-4bbbec4be655 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:40.513599 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2bd6a-9456-4be4-8e3c-4bbbec4be655 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:40.523644 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503faa5-2dbb-472d-b719-576e4fb8720b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:40.524347 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503faa5-2dbb-472d-b719-576e4fb8720b None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:40.524694 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503faa5-2dbb-472d-b719-576e4fb8720b None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:40.524797 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2bd6a-9456-4be4-8e3c-4bbbec4be655 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:40.525083 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503faa5-2dbb-472d-b719-576e4fb8720b None admin] PATH_INFO: `/v3/domains` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:40.525783 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503faa5-2dbb-472d-b719-576e4fb8720b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:40.526152 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503faa5-2dbb-472d-b719-576e4fb8720b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:40.526248 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2bd6a-9456-4be4-8e3c-4bbbec4be655 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:40.527614 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503faa5-2dbb-472d-b719-576e4fb8720b None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:40.539148 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 277/553] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:49:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:40.539688 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-40b2bd6a-9456-4be4-8e3c-4bbbec4be655 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:40.539688 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:40.539688 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:40.539688 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:40.539688 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:40.539688 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:40.539688 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:40.539688 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:40.539688 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:40.539688 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:40.539688 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:40.539688 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:40.539688 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:49:40.539688 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:49:40.539688 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:49:40.539688 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:49:40.540853 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:40.540853 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:40.540853 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:40.540853 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:40.540853 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:40.540853 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:40.540853 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:40.540853 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:40.540853 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:40.540853 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:40.540853 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:40.540853 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:40.540853 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:40.540853 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:40.540853 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:40.540853 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:40.540853 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:49:40.542410 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:49:40.542410 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:40.542410 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:40.542610 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503faa5-2dbb-472d-b719-576e4fb8720b None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:40.542695 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 277/554] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:40.542695 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2bd6a-9456-4be4-8e3c-4bbbec4be655 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:40.642270 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2bd6a-9456-4be4-8e3c-4bbbec4be655 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:40.654158 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503faa5-2dbb-472d-b719-576e4fb8720b None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:40.677282 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbf63d-ccdf-475b-8015-dcc58bf82462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:40.677902 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbf63d-ccdf-475b-8015-dcc58bf82462 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:40.678177 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbf63d-ccdf-475b-8015-dcc58bf82462 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:40.678446 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbf63d-ccdf-475b-8015-dcc58bf82462 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:40.687881 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074c8fa-cfd0-4311-806f-f5249ec16163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:40.688513 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074c8fa-cfd0-4311-806f-f5249ec16163 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:40.688780 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074c8fa-cfd0-4311-806f-f5249ec16163 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:40.689043 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074c8fa-cfd0-4311-806f-f5249ec16163 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:40.689856 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dbf63d-ccdf-475b-8015-dcc58bf82462 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:40.691294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dbf63d-ccdf-475b-8015-dcc58bf82462 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:40.698704 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074c8fa-cfd0-4311-806f-f5249ec16163 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:40.700147 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074c8fa-cfd0-4311-806f-f5249ec16163 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:40.705278 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-21dbf63d-ccdf-475b-8015-dcc58bf82462 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:40.705278 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:40.705278 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:40.705278 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:40.705278 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:40.705278 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:40.705278 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:40.705278 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:40.705278 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:40.705278 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:40.705278 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:40.705278 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:40.705278 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:49:40.705278 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:49:40.705278 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:49:40.705278 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:49:40.706294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:40.706294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:40.706294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:40.706294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:40.706294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:40.706294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:40.706294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:40.706294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:40.706294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:40.706294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:40.706294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:40.706294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:40.706294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:40.706294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:40.706294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:40.706294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:40.706294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:49:40.707178 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:49:40.707178 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:40.707178 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:40.707178 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 278/555] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:40.707178 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbf63d-ccdf-475b-8015-dcc58bf82462 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:40.713066 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:40.720417 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-6074c8fa-cfd0-4311-806f-f5249ec16163 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:40.720417 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:40.720417 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:40.720417 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:40.720417 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:40.720417 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:40.720417 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:40.720417 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:40.720417 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:40.720417 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:40.720417 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:40.720417 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:40.720417 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:49:40.720417 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:49:40.720417 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:49:40.720417 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:49:40.721519 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:40.721519 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:40.721519 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:40.721519 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:40.721519 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:40.721519 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:40.721519 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:40.721519 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:40.721519 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:40.721519 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:40.721519 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:40.721519 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:40.721519 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:40.721519 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:40.721519 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:40.721519 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:40.721519 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:49:40.722596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:49:40.722596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:40.722596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:40.723971 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 278/556] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:40.724897 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074c8fa-cfd0-4311-806f-f5249ec16163 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:40.729924 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:40.805866 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbf63d-ccdf-475b-8015-dcc58bf82462 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:40.822249 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074c8fa-cfd0-4311-806f-f5249ec16163 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:40.839579 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229de5db-8de7-473a-b8a4-07e45cd8a8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:40.840166 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229de5db-8de7-473a-b8a4-07e45cd8a8a1 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:40.840447 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229de5db-8de7-473a-b8a4-07e45cd8a8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:40.840718 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229de5db-8de7-473a-b8a4-07e45cd8a8a1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:40.848147 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229de5db-8de7-473a-b8a4-07e45cd8a8a1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:40.849583 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229de5db-8de7-473a-b8a4-07e45cd8a8a1 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:40.855635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fad69c-a675-4b9e-ac97-f0d11f43ec9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:40.856393 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fad69c-a675-4b9e-ac97-f0d11f43ec9f None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:40.856668 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fad69c-a675-4b9e-ac97-f0d11f43ec9f None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:40.856932 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fad69c-a675-4b9e-ac97-f0d11f43ec9f None admin] PATH_INFO: `/v3/domains` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:40.857558 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fad69c-a675-4b9e-ac97-f0d11f43ec9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:40.857852 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fad69c-a675-4b9e-ac97-f0d11f43ec9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:40.859188 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fad69c-a675-4b9e-ac97-f0d11f43ec9f None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:40.860946 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-229de5db-8de7-473a-b8a4-07e45cd8a8a1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 21 11:49:40.860946 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:40.860946 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:40.860946 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:40.860946 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:40.860946 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:40.860946 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:40.860946 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:40.860946 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:40.860946 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:40.860946 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:40.860946 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:40.860946 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 11:49:40.860946 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 11:49:40.860946 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 11:49:40.860946 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 11:49:40.862398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:40.862398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:40.862398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 11:49:40.862398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:49:40.862398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 11:49:40.862398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:49:40.862398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:40.862398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:40.862398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:40.862398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:40.862398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:40.862398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:40.862398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:40.862398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:40.862398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:40.862398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:40.862398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:40.862398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:40.863375 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:40.863375 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:40.863375 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 11:49:40.863375 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 11:49:40.863375 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 11:49:40.863375 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 11:49:40.863375 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 11:49:40.863375 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 11:49:40.863375 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 21 11:49:40.863375 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:40.863375 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 279/557] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:49:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:40.863375 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229de5db-8de7-473a-b8a4-07e45cd8a8a1 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:40.874477 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 279/558] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:49:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:40.875557 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fad69c-a675-4b9e-ac97-f0d11f43ec9f None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:40.932279 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:40.946854 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:40.966544 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229de5db-8de7-473a-b8a4-07e45cd8a8a1 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:40.976922 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fad69c-a675-4b9e-ac97-f0d11f43ec9f None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:40.999314 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ee994-0b48-4332-a16d-4417c0410628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:40.999925 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ee994-0b48-4332-a16d-4417c0410628 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:41.000233 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ee994-0b48-4332-a16d-4417c0410628 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:41.000507 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ee994-0b48-4332-a16d-4417c0410628 None admin] PATH_INFO: `/v3/domains` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:41.001228 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ee994-0b48-4332-a16d-4417c0410628 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:41.001528 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ee994-0b48-4332-a16d-4417c0410628 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:41.002891 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ee994-0b48-4332-a16d-4417c0410628 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:41.015166 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 280/559] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:49:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:41.015970 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ee994-0b48-4332-a16d-4417c0410628 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:41.017936 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c231a-8828-495b-992e-bbeb91ec87d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:41.018761 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c231a-8828-495b-992e-bbeb91ec87d3 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:41.019042 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c231a-8828-495b-992e-bbeb91ec87d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:41.020164 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c231a-8828-495b-992e-bbeb91ec87d3 None admin] PATH_INFO: `/v3/domains` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:41.020844 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c231a-8828-495b-992e-bbeb91ec87d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:41.021146 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c231a-8828-495b-992e-bbeb91ec87d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:41.022510 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c231a-8828-495b-992e-bbeb91ec87d3 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:41.034467 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 280/560] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:49:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:41.035123 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c231a-8828-495b-992e-bbeb91ec87d3 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:41.118311 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ee994-0b48-4332-a16d-4417c0410628 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:41.132464 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c231a-8828-495b-992e-bbeb91ec87d3 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:41.151267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e416062e-c2e9-4ef3-9e97-3e241883ddcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:41.151850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416062e-c2e9-4ef3-9e97-3e241883ddcd None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:41.152153 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416062e-c2e9-4ef3-9e97-3e241883ddcd None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:41.152420 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416062e-c2e9-4ef3-9e97-3e241883ddcd None admin] PATH_INFO: `/v3/users` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:41.152516 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:41.153129 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e416062e-c2e9-4ef3-9e97-3e241883ddcd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:41.153529 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e416062e-c2e9-4ef3-9e97-3e241883ddcd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:41.154838 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e416062e-c2e9-4ef3-9e97-3e241883ddcd None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:41.163256 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:41.169370 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460279e3-6c04-4daf-a38b-ab745c2de1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:41.169989 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460279e3-6c04-4daf-a38b-ab745c2de1d5 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:41.170267 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460279e3-6c04-4daf-a38b-ab745c2de1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:41.170535 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460279e3-6c04-4daf-a38b-ab745c2de1d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:41.173511 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 281/561] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Sep 21 11:49:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:41.174304 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e416062e-c2e9-4ef3-9e97-3e241883ddcd None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:41.177307 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460279e3-6c04-4daf-a38b-ab745c2de1d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:41.178764 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460279e3-6c04-4daf-a38b-ab745c2de1d5 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:41.189935 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-460279e3-6c04-4daf-a38b-ab745c2de1d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:49:41.189935 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:41.189935 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:41.189935 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:41.189935 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:41.189935 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:41.189935 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:41.189935 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:41.189935 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:41.189935 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:41.189935 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:41.189935 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:41.189935 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 11:49:41.189935 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 11:49:41.189935 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 11:49:41.190891 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 11:49:41.190891 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:41.190891 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:41.190891 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:41.190891 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:41.190891 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:41.190891 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:41.190891 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:41.190891 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:41.190891 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:41.190891 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:41.190891 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:41.190891 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:41.190891 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:41.190891 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:41.190891 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:41.190891 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:41.196834 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 11:49:41.196834 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 11:49:41.196834 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 11:49:41.196834 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 11:49:41.196834 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 11:49:41.196834 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 11:49:41.196834 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:49:41.196834 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:41.196834 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 281/562] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:49:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:41.196834 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460279e3-6c04-4daf-a38b-ab745c2de1d5 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:41.276813 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e416062e-c2e9-4ef3-9e97-3e241883ddcd None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:41.292700 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460279e3-6c04-4daf-a38b-ab745c2de1d5 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:41.310357 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e57d9f-97a8-4135-aadc-96b3c607617f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:41.310977 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e57d9f-97a8-4135-aadc-96b3c607617f None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:41.311256 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e57d9f-97a8-4135-aadc-96b3c607617f None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:41.311533 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e57d9f-97a8-4135-aadc-96b3c607617f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:41.318335 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e57d9f-97a8-4135-aadc-96b3c607617f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:41.319777 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e57d9f-97a8-4135-aadc-96b3c607617f None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:41.325628 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a70fe-532a-49e6-97a1-20f07ca279b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:41.326468 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a70fe-532a-49e6-97a1-20f07ca279b8 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:41.326873 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a70fe-532a-49e6-97a1-20f07ca279b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:41.327270 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a70fe-532a-49e6-97a1-20f07ca279b8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:41.331114 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-b1e57d9f-97a8-4135-aadc-96b3c607617f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 21 11:49:41.331114 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:41.331114 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:41.331114 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:41.331114 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:41.331114 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:41.331114 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:41.331114 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:41.331114 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:41.331114 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:41.331114 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:41.331114 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:41.331114 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 11:49:41.331114 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 11:49:41.331114 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 11:49:41.331114 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 11:49:41.332261 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:41.332261 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:41.332261 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 11:49:41.332261 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:49:41.332261 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 11:49:41.332261 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:49:41.332261 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:41.332261 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:41.332261 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:41.332261 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:41.332261 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:41.332261 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:41.332261 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:41.332261 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:41.332261 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:41.332261 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:41.332261 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:41.332261 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:41.333252 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:41.333252 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:41.333252 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 11:49:41.333252 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 11:49:41.333252 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 11:49:41.333252 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 11:49:41.333252 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 11:49:41.333252 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 11:49:41.333252 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 21 11:49:41.333252 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:41.333252 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 282/563] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 11:49:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:41.333252 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e57d9f-97a8-4135-aadc-96b3c607617f None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:41.335122 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a70fe-532a-49e6-97a1-20f07ca279b8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:41.336597 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a70fe-532a-49e6-97a1-20f07ca279b8 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:41.348814 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-629a70fe-532a-49e6-97a1-20f07ca279b8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 11:49:41.348814 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:41.348814 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:41.348814 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:41.348814 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:41.348814 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:41.348814 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:41.348814 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:41.348814 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:41.348814 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:41.348814 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:41.348814 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:41.348814 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 11:49:41.348814 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 11:49:41.348814 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 11:49:41.348814 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 11:49:41.349824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:41.349824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:41.349824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 11:49:41.349824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:49:41.349824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 11:49:41.349824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:49:41.349824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:41.349824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:41.349824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:41.349824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:41.349824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:41.349824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:41.349824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:41.349824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:41.349824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:41.349824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:41.349824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:41.349824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:41.350981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:41.350981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:41.350981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 11:49:41.350981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 11:49:41.350981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 11:49:41.350981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 11:49:41.350981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 11:49:41.350981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 11:49:41.350981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 11:49:41.350981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:41.350981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 282/564] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:49:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:41.350981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a70fe-532a-49e6-97a1-20f07ca279b8 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:41.392342 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:41.394924 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:41.436090 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e57d9f-97a8-4135-aadc-96b3c607617f None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:41.450879 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a70fe-532a-49e6-97a1-20f07ca279b8 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:41.470121 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdbc84a-8b6f-4e33-80cf-61af4008cb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:41.470740 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbc84a-8b6f-4e33-80cf-61af4008cb25 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:41.471014 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbc84a-8b6f-4e33-80cf-61af4008cb25 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:41.471284 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbc84a-8b6f-4e33-80cf-61af4008cb25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:41.482066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdbc84a-8b6f-4e33-80cf-61af4008cb25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:41.483513 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdbc84a-8b6f-4e33-80cf-61af4008cb25 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:41.483628 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a14fc-e386-4893-bde9-0ad3faf8df75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:41.484216 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a14fc-e386-4893-bde9-0ad3faf8df75 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:41.484487 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a14fc-e386-4893-bde9-0ad3faf8df75 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:41.484751 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a14fc-e386-4893-bde9-0ad3faf8df75 None admin] PATH_INFO: `/v3/projects` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:41.485425 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a14fc-e386-4893-bde9-0ad3faf8df75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:41.485718 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a14fc-e386-4893-bde9-0ad3faf8df75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:41.487104 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a14fc-e386-4893-bde9-0ad3faf8df75 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:41.497248 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-bfdbc84a-8b6f-4e33-80cf-61af4008cb25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:41.497248 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:41.497248 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:41.497248 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:41.497248 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:41.497248 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:41.497248 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:41.497248 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:41.497248 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:41.497248 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:41.497248 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:41.497248 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:41.497248 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:49:41.497248 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:49:41.497248 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:49:41.497248 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:49:41.498367 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:41.498367 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:41.498367 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:41.498367 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:41.498367 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:41.498367 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:41.498367 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:41.498367 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:41.498367 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:41.498367 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:41.498367 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:41.498367 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:41.498367 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:41.498367 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:41.498367 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:41.498367 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:41.498367 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:49:41.499549 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:49:41.499549 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:41.499549 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:41.502957 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 283/565] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:41.503611 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdbc84a-8b6f-4e33-80cf-61af4008cb25 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:41.504101 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 283/566] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 11:49:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:41.504906 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a14fc-e386-4893-bde9-0ad3faf8df75 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:41.602614 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:41.605675 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a14fc-e386-4893-bde9-0ad3faf8df75 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:41.607881 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdbc84a-8b6f-4e33-80cf-61af4008cb25 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:41.618064 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:41.639568 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f140dd3-6e6a-47f2-b695-58b5819521ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:41.640263 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f140dd3-6e6a-47f2-b695-58b5819521ea None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:41.640544 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f140dd3-6e6a-47f2-b695-58b5819521ea None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:41.640812 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f140dd3-6e6a-47f2-b695-58b5819521ea None admin] PATH_INFO: `/v3/users` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:41.641527 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f140dd3-6e6a-47f2-b695-58b5819521ea None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:41.641828 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f140dd3-6e6a-47f2-b695-58b5819521ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:41.642299 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8004f6-cdc4-44ce-b3c1-515f2878c9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:41.642939 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8004f6-cdc4-44ce-b3c1-515f2878c9ad None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:41.643165 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8004f6-cdc4-44ce-b3c1-515f2878c9ad None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:41.643256 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f140dd3-6e6a-47f2-b695-58b5819521ea None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:41.643432 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8004f6-cdc4-44ce-b3c1-515f2878c9ad None admin] PATH_INFO: `/v3/users` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:41.644172 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8004f6-cdc4-44ce-b3c1-515f2878c9ad None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:41.644469 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8004f6-cdc4-44ce-b3c1-515f2878c9ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:41.645851 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8004f6-cdc4-44ce-b3c1-515f2878c9ad None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:41.660565 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 284/567] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Sep 21 11:49:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:41.661362 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f140dd3-6e6a-47f2-b695-58b5819521ea None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:41.663200 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 284/568] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Sep 21 11:49:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:41.664863 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8004f6-cdc4-44ce-b3c1-515f2878c9ad None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:41.760413 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f140dd3-6e6a-47f2-b695-58b5819521ea None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:41.763354 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8004f6-cdc4-44ce-b3c1-515f2878c9ad None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:41.796917 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f885a9-1e6e-42ef-9b20-18181f4c02cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:41.797662 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f885a9-1e6e-42ef-9b20-18181f4c02cb None admin] REQUEST_METHOD: `PUT` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:41.797943 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f885a9-1e6e-42ef-9b20-18181f4c02cb None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:41.798217 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f885a9-1e6e-42ef-9b20-18181f4c02cb None admin] PATH_INFO: `/v3/projects/1fd87b195f7c46d2a0d621124acce331/users/c683dcd33e5b40fabbbf12c3dcf97eb1/roles/1557d254ce394d9e8d83e9c55cc20445` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:41.798448 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb254b9-75c4-4bf9-b7ec-de467baf6baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:41.799039 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb254b9-75c4-4bf9-b7ec-de467baf6baf None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:41.799313 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb254b9-75c4-4bf9-b7ec-de467baf6baf None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:41.799583 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb254b9-75c4-4bf9-b7ec-de467baf6baf None admin] PATH_INFO: `/v3/domains` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:41.800250 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb254b9-75c4-4bf9-b7ec-de467baf6baf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:41.800558 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb254b9-75c4-4bf9-b7ec-de467baf6baf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:41.801922 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb254b9-75c4-4bf9-b7ec-de467baf6baf None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:41.813883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 285/569] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:41.814038 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f885a9-1e6e-42ef-9b20-18181f4c02cb None admin] RBAC: Authorizing `identity:create_grant(project_id=1fd87b195f7c46d2a0d621124acce331, user_id=c683dcd33e5b40fabbbf12c3dcf97eb1, role_id=1557d254ce394d9e8d83e9c55cc20445)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:41.814674 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb254b9-75c4-4bf9-b7ec-de467baf6baf None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:41.815680 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f885a9-1e6e-42ef-9b20-18181f4c02cb None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:41.828876 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 285/570] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 11:49:41 2022] PUT /identity/v3/projects/1fd87b195f7c46d2a0d621124acce331/users/c683dcd33e5b40fabbbf12c3dcf97eb1/roles/1557d254ce394d9e8d83e9c55cc20445 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 11:49:41.829849 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f885a9-1e6e-42ef-9b20-18181f4c02cb None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:41.849542 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:41.856918 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:41.949375 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb254b9-75c4-4bf9-b7ec-de467baf6baf None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:41.960883 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f885a9-1e6e-42ef-9b20-18181f4c02cb None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:41.988292 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7440c17-cb1e-447e-b241-b091e963e3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:41.989046 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7440c17-cb1e-447e-b241-b091e963e3ff None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:41.989321 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7440c17-cb1e-447e-b241-b091e963e3ff None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:41.989591 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7440c17-cb1e-447e-b241-b091e963e3ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:41.997502 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d013f8-4ca2-4a38-b09b-58f9a0e50ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:41.998149 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d013f8-4ca2-4a38-b09b-58f9a0e50ad8 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:41.998425 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d013f8-4ca2-4a38-b09b-58f9a0e50ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:41.998695 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d013f8-4ca2-4a38-b09b-58f9a0e50ad8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:42.003409 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7440c17-cb1e-447e-b241-b091e963e3ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:42.005037 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7440c17-cb1e-447e-b241-b091e963e3ff None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:42.010366 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d013f8-4ca2-4a38-b09b-58f9a0e50ad8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:42.011843 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d013f8-4ca2-4a38-b09b-58f9a0e50ad8 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:42.021904 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-a7440c17-cb1e-447e-b241-b091e963e3ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:42.021904 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:42.021904 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:42.021904 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:42.021904 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:42.021904 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:42.021904 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:42.021904 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:42.021904 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:42.021904 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:42.021904 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:42.021904 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:42.021904 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:49:42.021904 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:49:42.021904 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:49:42.021904 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:49:42.023058 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:42.023058 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:42.023058 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:42.023058 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:42.023058 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:42.023058 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:42.023058 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:42.023058 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:42.023058 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:42.023058 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:42.023058 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:42.023058 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:42.023058 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:42.023058 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:42.023058 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:42.023058 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:42.023058 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:49:42.024581 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:49:42.024581 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:42.024581 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:42.024581 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 286/571] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:42.024581 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7440c17-cb1e-447e-b241-b091e963e3ff None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:42.032703 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-a9d013f8-4ca2-4a38-b09b-58f9a0e50ad8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:42.032703 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:42.032703 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:42.032703 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:42.032703 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:42.032703 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:42.032703 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:42.032703 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:42.032703 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:42.032703 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:42.032703 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:42.032703 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:42.032703 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:49:42.032703 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:49:42.032703 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:49:42.032703 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:49:42.033725 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:42.033725 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:42.033725 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:42.033725 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:42.033725 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:42.033725 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:42.033725 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:42.033725 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:42.033725 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:42.033725 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:42.033725 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:42.033725 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:42.033725 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:42.033725 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:42.033725 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:42.033725 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:42.033725 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:49:42.034662 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:49:42.034662 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:42.034662 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:42.036095 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 286/572] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:42.036095 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d013f8-4ca2-4a38-b09b-58f9a0e50ad8 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:42.105579 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:42.123256 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:42.140224 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7440c17-cb1e-447e-b241-b091e963e3ff None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:42.157774 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d013f8-4ca2-4a38-b09b-58f9a0e50ad8 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:42.176840 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade90c02-4eae-470f-8f41-0f770d8b2992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:42.177453 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade90c02-4eae-470f-8f41-0f770d8b2992 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:42.177723 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade90c02-4eae-470f-8f41-0f770d8b2992 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:42.177986 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade90c02-4eae-470f-8f41-0f770d8b2992 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:42.185251 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade90c02-4eae-470f-8f41-0f770d8b2992 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:42.187205 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade90c02-4eae-470f-8f41-0f770d8b2992 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:42.194526 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03556fd0-b9e3-4cbd-98d3-eacef96e18e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:42.195127 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03556fd0-b9e3-4cbd-98d3-eacef96e18e0 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:42.195408 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03556fd0-b9e3-4cbd-98d3-eacef96e18e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:42.195681 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03556fd0-b9e3-4cbd-98d3-eacef96e18e0 None admin] PATH_INFO: `/v3/domains` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:42.196355 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03556fd0-b9e3-4cbd-98d3-eacef96e18e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:42.196689 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03556fd0-b9e3-4cbd-98d3-eacef96e18e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:42.198044 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03556fd0-b9e3-4cbd-98d3-eacef96e18e0 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:42.198476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-ade90c02-4eae-470f-8f41-0f770d8b2992 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:49:42.198476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:42.198476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:42.198476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:42.198476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:42.198476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:42.198476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:42.198476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:42.198476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:42.198476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:42.198476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:42.198476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:42.198476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 11:49:42.198476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 11:49:42.198476 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 11:49:42.199354 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 11:49:42.199354 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:42.199354 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:42.199354 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:42.199354 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:42.199354 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:42.199354 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:42.199354 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:42.199354 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:42.199354 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:42.199354 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:42.199354 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:42.199354 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:42.199354 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:42.199354 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:42.199354 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:42.199354 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:42.200355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 11:49:42.200355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 11:49:42.200355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 11:49:42.200355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 11:49:42.200355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 11:49:42.200355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 11:49:42.200355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:49:42.200355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:42.200355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 287/573] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:49:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:42.200355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade90c02-4eae-470f-8f41-0f770d8b2992 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:42.221360 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 287/574] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:42.221360 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03556fd0-b9e3-4cbd-98d3-eacef96e18e0 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:42.309546 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade90c02-4eae-470f-8f41-0f770d8b2992 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:42.323736 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03556fd0-b9e3-4cbd-98d3-eacef96e18e0 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:42.337367 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:42.344433 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefab64-6e59-4b68-9cae-24f65ac4e649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:42.345055 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefab64-6e59-4b68-9cae-24f65ac4e649 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:42.345403 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefab64-6e59-4b68-9cae-24f65ac4e649 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:42.345670 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefab64-6e59-4b68-9cae-24f65ac4e649 None admin] PATH_INFO: `/v3/domains` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:42.346310 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfefab64-6e59-4b68-9cae-24f65ac4e649 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:42.346608 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfefab64-6e59-4b68-9cae-24f65ac4e649 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:42.347962 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfefab64-6e59-4b68-9cae-24f65ac4e649 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:42.358081 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:42.364947 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407fdca-550a-4e9d-a79c-7e7d68f1fd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:42.365551 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407fdca-550a-4e9d-a79c-7e7d68f1fd4e None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:42.365831 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407fdca-550a-4e9d-a79c-7e7d68f1fd4e None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:42.366317 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407fdca-550a-4e9d-a79c-7e7d68f1fd4e None admin] PATH_INFO: `/v3/projects` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:42.366456 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 288/575] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:42.367016 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407fdca-550a-4e9d-a79c-7e7d68f1fd4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:42.367323 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefab64-6e59-4b68-9cae-24f65ac4e649 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:42.367488 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407fdca-550a-4e9d-a79c-7e7d68f1fd4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:42.369667 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407fdca-550a-4e9d-a79c-7e7d68f1fd4e None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:42.384716 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 288/576] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 11:49:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:42.385813 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407fdca-550a-4e9d-a79c-7e7d68f1fd4e None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:42.479818 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefab64-6e59-4b68-9cae-24f65ac4e649 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:42.497872 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407fdca-550a-4e9d-a79c-7e7d68f1fd4e None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:42.513692 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb336092-1f22-44c8-904c-874ed1148b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:42.514395 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb336092-1f22-44c8-904c-874ed1148b32 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:42.514739 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb336092-1f22-44c8-904c-874ed1148b32 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:42.515290 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb336092-1f22-44c8-904c-874ed1148b32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:42.521870 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb336092-1f22-44c8-904c-874ed1148b32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:42.523386 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb336092-1f22-44c8-904c-874ed1148b32 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:42.532513 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81551f43-0135-4e39-aa46-afea1d43b57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:42.533212 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81551f43-0135-4e39-aa46-afea1d43b57a None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:42.533548 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81551f43-0135-4e39-aa46-afea1d43b57a None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:42.533880 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81551f43-0135-4e39-aa46-afea1d43b57a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:42.535638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-eb336092-1f22-44c8-904c-874ed1148b32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:49:42.535638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:42.535638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:42.535638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:42.535638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:42.535638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:42.535638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:42.535638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:42.535638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:42.535638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:42.535638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:42.535638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:42.535638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 11:49:42.535638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 11:49:42.535638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 11:49:42.536730 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 11:49:42.536730 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:42.536730 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:42.536730 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:42.536730 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:42.536730 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:42.536730 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:42.536730 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:42.536730 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:42.536730 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:42.536730 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:42.536730 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:42.536730 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:42.536730 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:42.536730 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:42.536730 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:42.536730 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:42.537664 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 11:49:42.537664 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 11:49:42.537664 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 11:49:42.537664 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 11:49:42.537664 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 11:49:42.537664 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 11:49:42.537664 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:49:42.537664 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:42.537664 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 289/577] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:49:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:42.537664 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb336092-1f22-44c8-904c-874ed1148b32 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:42.547544 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81551f43-0135-4e39-aa46-afea1d43b57a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:42.549020 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81551f43-0135-4e39-aa46-afea1d43b57a None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:42.561097 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-81551f43-0135-4e39-aa46-afea1d43b57a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:49:42.561097 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:42.561097 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:42.561097 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:42.561097 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:42.561097 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:42.561097 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:42.561097 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:42.561097 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:42.561097 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:42.561097 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:42.561097 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:42.561097 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 11:49:42.561097 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 11:49:42.561097 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 11:49:42.562205 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 11:49:42.562205 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:42.562205 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:42.562205 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:42.562205 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:42.562205 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:42.562205 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:42.562205 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:42.562205 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:42.562205 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:42.562205 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:42.562205 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:42.562205 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:42.562205 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:42.562205 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:42.562205 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:42.562205 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:42.563326 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 11:49:42.563326 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 11:49:42.563326 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 11:49:42.563326 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 11:49:42.563326 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 11:49:42.563326 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 11:49:42.563326 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:49:42.563326 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:42.566982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 289/578] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:49:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:42.567823 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81551f43-0135-4e39-aa46-afea1d43b57a None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:42.604206 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:42.622632 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:42.660130 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb336092-1f22-44c8-904c-874ed1148b32 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:42.683935 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81551f43-0135-4e39-aa46-afea1d43b57a None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:42.698647 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26395ce-92d6-4d1e-b6b8-ddd9da71ae3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:42.699248 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26395ce-92d6-4d1e-b6b8-ddd9da71ae3f None admin] REQUEST_METHOD: `PUT` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:42.699533 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26395ce-92d6-4d1e-b6b8-ddd9da71ae3f None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:42.699802 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26395ce-92d6-4d1e-b6b8-ddd9da71ae3f None admin] PATH_INFO: `/v3/projects/1fd87b195f7c46d2a0d621124acce331/users/f4e6b7bc6eea49ba9f54b0305f3173b0/roles/1557d254ce394d9e8d83e9c55cc20445` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:42.715464 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26395ce-92d6-4d1e-b6b8-ddd9da71ae3f None admin] RBAC: Authorizing `identity:create_grant(project_id=1fd87b195f7c46d2a0d621124acce331, user_id=f4e6b7bc6eea49ba9f54b0305f3173b0, role_id=1557d254ce394d9e8d83e9c55cc20445)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:42.716925 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26395ce-92d6-4d1e-b6b8-ddd9da71ae3f None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:42.722058 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e323274-d400-49e0-83be-b46ae4c4fbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:42.722670 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e323274-d400-49e0-83be-b46ae4c4fbfa None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:42.722952 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e323274-d400-49e0-83be-b46ae4c4fbfa None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:42.723222 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e323274-d400-49e0-83be-b46ae4c4fbfa None admin] PATH_INFO: `/v3/projects` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:42.723870 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e323274-d400-49e0-83be-b46ae4c4fbfa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:42.724265 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e323274-d400-49e0-83be-b46ae4c4fbfa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:42.725801 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e323274-d400-49e0-83be-b46ae4c4fbfa None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:42.740435 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 290/579] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 11:49:42 2022] PUT /identity/v3/projects/1fd87b195f7c46d2a0d621124acce331/users/f4e6b7bc6eea49ba9f54b0305f3173b0/roles/1557d254ce394d9e8d83e9c55cc20445 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 11:49:42.740435 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26395ce-92d6-4d1e-b6b8-ddd9da71ae3f None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:42.751724 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 290/580] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 11:49:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:42.758618 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e323274-d400-49e0-83be-b46ae4c4fbfa None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:42.861511 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:42.865023 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26395ce-92d6-4d1e-b6b8-ddd9da71ae3f None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:42.905326 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e323274-d400-49e0-83be-b46ae4c4fbfa None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:42.914455 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde11c11-42ca-41e6-a9ed-415d95dbf0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:42.916206 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde11c11-42ca-41e6-a9ed-415d95dbf0b1 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:42.916687 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde11c11-42ca-41e6-a9ed-415d95dbf0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:42.917125 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde11c11-42ca-41e6-a9ed-415d95dbf0b1 None admin] PATH_INFO: `/v3/projects` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:42.918000 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde11c11-42ca-41e6-a9ed-415d95dbf0b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:42.918584 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde11c11-42ca-41e6-a9ed-415d95dbf0b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:42.920342 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:42.920643 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde11c11-42ca-41e6-a9ed-415d95dbf0b1 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:42.935812 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 291/581] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 11:49:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:42.941411 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde11c11-42ca-41e6-a9ed-415d95dbf0b1 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:42.963999 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ef349-21b9-4126-bc99-05ac1409faa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:42.964758 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ef349-21b9-4126-bc99-05ac1409faa9 None admin] REQUEST_METHOD: `PUT` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:42.965038 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ef349-21b9-4126-bc99-05ac1409faa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:42.965365 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ef349-21b9-4126-bc99-05ac1409faa9 None admin] PATH_INFO: `/v3/projects/1fd87b195f7c46d2a0d621124acce331/users/75426336bd2d443fbe3f2dd97293fc15/roles/1557d254ce394d9e8d83e9c55cc20445` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:42.984723 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ef349-21b9-4126-bc99-05ac1409faa9 None admin] RBAC: Authorizing `identity:create_grant(project_id=1fd87b195f7c46d2a0d621124acce331, user_id=75426336bd2d443fbe3f2dd97293fc15, role_id=1557d254ce394d9e8d83e9c55cc20445)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:42.986185 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ef349-21b9-4126-bc99-05ac1409faa9 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:43.002702 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 291/582] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 11:49:42 2022] PUT /identity/v3/projects/1fd87b195f7c46d2a0d621124acce331/users/75426336bd2d443fbe3f2dd97293fc15/roles/1557d254ce394d9e8d83e9c55cc20445 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 11:49:43.080162 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde11c11-42ca-41e6-a9ed-415d95dbf0b1 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:43.121204 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0cd5d6-0ab4-40af-9b3b-614327f6a051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:43.122345 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cd5d6-0ab4-40af-9b3b-614327f6a051 None admin] REQUEST_METHOD: `PUT` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:43.122833 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cd5d6-0ab4-40af-9b3b-614327f6a051 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:43.123336 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cd5d6-0ab4-40af-9b3b-614327f6a051 None admin] PATH_INFO: `/v3/projects/1fd87b195f7c46d2a0d621124acce331/users/1cf371d784014c68a9ff4c301dad5ca9/roles/1557d254ce394d9e8d83e9c55cc20445` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:43.143368 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0cd5d6-0ab4-40af-9b3b-614327f6a051 None admin] RBAC: Authorizing `identity:create_grant(project_id=1fd87b195f7c46d2a0d621124acce331, user_id=1cf371d784014c68a9ff4c301dad5ca9, role_id=1557d254ce394d9e8d83e9c55cc20445)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:43.144912 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0cd5d6-0ab4-40af-9b3b-614327f6a051 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:43.162011 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 292/583] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 11:49:42 2022] PUT /identity/v3/projects/1fd87b195f7c46d2a0d621124acce331/users/1cf371d784014c68a9ff4c301dad5ca9/roles/1557d254ce394d9e8d83e9c55cc20445 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 11:49:44.267724 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2daef-7819-4e8f-93d8-2750759a7dc5 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:44.268275 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2daef-7819-4e8f-93d8-2750759a7dc5 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:44.268275 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2daef-7819-4e8f-93d8-2750759a7dc5 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:44.269851 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 292/584] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:44.275514 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795794f-71c4-4683-842c-69c481b95b7f None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:44.275972 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795794f-71c4-4683-842c-69c481b95b7f None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:44.276304 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795794f-71c4-4683-842c-69c481b95b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:44.295324 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-7795794f-71c4-4683-842c-69c481b95b7f None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:44.296731 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-7795794f-71c4-4683-842c-69c481b95b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:44.300241 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:44.371578 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 293/585] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:49:44.691490 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2daef-7819-4e8f-93d8-2750759a7dc5 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:44.796316 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2daef-7819-4e8f-93d8-2750759a7dc5 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:44.831278 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f568288-6a6f-47bd-89e8-3fc4d31cc4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:44.831940 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f568288-6a6f-47bd-89e8-3fc4d31cc4a6 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:44.832243 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f568288-6a6f-47bd-89e8-3fc4d31cc4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:44.832509 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f568288-6a6f-47bd-89e8-3fc4d31cc4a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:44.849401 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f568288-6a6f-47bd-89e8-3fc4d31cc4a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:44.854976 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-0f568288-6a6f-47bd-89e8-3fc4d31cc4a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 11:49:44.854976 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:44.854976 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:44.854976 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:44.854976 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:44.854976 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:44.854976 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:44.854976 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:44.854976 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:44.854976 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:44.854976 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:44.854976 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:44.854976 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:44.854976 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:44.854976 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:44.854976 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:44.855982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:44.855982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:44.855982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:44.855982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:44.855982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:44.855982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:44.855982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:44.855982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:44.855982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:44.855982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:44.855982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:44.855982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:44.855982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:44.855982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:44.855982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:44.855982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:44.856871 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:44.856871 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:44.856871 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:44.856871 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:44.856871 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:44.856871 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:44.856871 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:44.856871 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:44.856871 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:44.856871 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:44.856871 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 11:49:44.856871 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:44.856871 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 293/586] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 11:49:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:44.862309 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795794f-71c4-4683-842c-69c481b95b7f None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:44.982172 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795794f-71c4-4683-842c-69c481b95b7f None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:45.017756 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01025dcb-533f-496c-9d80-12322f7b6b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:45.018352 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01025dcb-533f-496c-9d80-12322f7b6b81 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:45.018623 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01025dcb-533f-496c-9d80-12322f7b6b81 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:45.018885 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01025dcb-533f-496c-9d80-12322f7b6b81 None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:45.019542 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01025dcb-533f-496c-9d80-12322f7b6b81 None admin] RBAC: Adding query filter params (name=service) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:45.019889 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01025dcb-533f-496c-9d80-12322f7b6b81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:45.021381 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01025dcb-533f-496c-9d80-12322f7b6b81 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:45.030107 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 294/587] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 11:49:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:45.035702 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f568288-6a6f-47bd-89e8-3fc4d31cc4a6 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:45.059431 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:45.145039 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f568288-6a6f-47bd-89e8-3fc4d31cc4a6 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:45.185039 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42a14c-9914-41b3-b596-4c3fdf0564e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:45.185708 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42a14c-9914-41b3-b596-4c3fdf0564e5 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:45.185979 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42a14c-9914-41b3-b596-4c3fdf0564e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:45.186278 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42a14c-9914-41b3-b596-4c3fdf0564e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:45.196792 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42a14c-9914-41b3-b596-4c3fdf0564e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:45.198228 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42a14c-9914-41b3-b596-4c3fdf0564e5 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:45.214089 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-7a42a14c-9914-41b3-b596-4c3fdf0564e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:45.214089 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:45.214089 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:45.214089 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:45.214089 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:45.214089 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:45.214089 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:45.214089 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:45.214089 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:45.214089 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:45.214089 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:45.214089 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:45.214089 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:49:45.214089 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:49:45.214089 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:49:45.214089 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:49:45.215178 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:45.215178 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:45.215178 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:45.215178 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:45.215178 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:45.215178 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:45.215178 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:45.215178 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:45.215178 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:45.215178 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:45.215178 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:45.215178 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:45.215178 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:45.215178 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:45.215178 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:45.215178 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:45.215178 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:49:45.216128 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:49:45.216128 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:45.216128 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:45.216128 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 294/588] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:45.222739 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01025dcb-533f-496c-9d80-12322f7b6b81 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:45.226275 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:45.316472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d38fb5-cba2-4ea9-be0f-52fc25d56404 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:45.317003 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d38fb5-cba2-4ea9-be0f-52fc25d56404 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:45.317083 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d38fb5-cba2-4ea9-be0f-52fc25d56404 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:45.318663 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 295/589] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 11:49:45.324499 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84514ae4-648d-466f-a767-b0f0222ea346 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:45.324767 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84514ae4-648d-466f-a767-b0f0222ea346 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:45.325035 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84514ae4-648d-466f-a767-b0f0222ea346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:45.342051 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01025dcb-533f-496c-9d80-12322f7b6b81 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:45.347554 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-84514ae4-648d-466f-a767-b0f0222ea346 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:45.349039 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-84514ae4-648d-466f-a767-b0f0222ea346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:45.382097 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5032508-433b-4aff-bf94-481d02c3ac3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:45.383299 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5032508-433b-4aff-bf94-481d02c3ac3d None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:45.384195 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5032508-433b-4aff-bf94-481d02c3ac3d None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:45.384548 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5032508-433b-4aff-bf94-481d02c3ac3d None admin] PATH_INFO: `/v3/domains` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:45.385252 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5032508-433b-4aff-bf94-481d02c3ac3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:45.385617 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5032508-433b-4aff-bf94-481d02c3ac3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:45.387050 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5032508-433b-4aff-bf94-481d02c3ac3d None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:45.400942 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 295/590] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:49:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:45.406586 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5032508-433b-4aff-bf94-481d02c3ac3d None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:45.428038 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 296/591] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:49:45.492327 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:45.516599 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5032508-433b-4aff-bf94-481d02c3ac3d None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:45.550692 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0daab-6664-4c26-92db-4544a8d6d35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:45.551307 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0daab-6664-4c26-92db-4544a8d6d35d None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:45.551575 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0daab-6664-4c26-92db-4544a8d6d35d None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:45.551841 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0daab-6664-4c26-92db-4544a8d6d35d None admin] PATH_INFO: `/v3/users/nova` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:45.559561 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0daab-6664-4c26-92db-4544a8d6d35d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:45.561225 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0daab-6664-4c26-92db-4544a8d6d35d None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:45.565039 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81075a80-9d07-4b7d-9322-a42ee5ebd361 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:45.565316 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81075a80-9d07-4b7d-9322-a42ee5ebd361 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:45.565574 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81075a80-9d07-4b7d-9322-a42ee5ebd361 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:45.567143 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 297/592] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 11:49:45.572518 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0453157-964e-4675-bb8a-d41ee67ecf89 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:45.572794 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0453157-964e-4675-bb8a-d41ee67ecf89 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:45.573060 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0453157-964e-4675-bb8a-d41ee67ecf89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:45.573979 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-bcf0daab-6664-4c26-92db-4544a8d6d35d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 11:49:45.573979 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:45.573979 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:45.573979 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:45.573979 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:45.573979 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:45.573979 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:45.573979 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:45.573979 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:45.573979 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:45.573979 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:45.573979 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:45.573979 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 11:49:45.573979 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 11:49:45.573979 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 11:49:45.573979 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 11:49:45.574899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:45.574899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:45.574899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 11:49:45.574899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:49:45.574899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 11:49:45.574899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:49:45.574899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:45.574899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:45.574899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:45.574899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:45.574899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:45.574899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:45.574899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:45.574899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:45.574899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:45.574899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:45.574899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:45.574899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:45.575869 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:45.575869 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:45.575869 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 11:49:45.575869 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 11:49:45.575869 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 11:49:45.575869 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 11:49:45.575869 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 11:49:45.575869 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 11:49:45.575869 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 11:49:45.575869 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:45.575869 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 296/593] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Sep 21 11:49:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:45.579365 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:45.584032 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0daab-6664-4c26-92db-4544a8d6d35d None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:45.597805 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-f0453157-964e-4675-bb8a-d41ee67ecf89 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:45.599144 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-f0453157-964e-4675-bb8a-d41ee67ecf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:45.675173 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 298/594] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 11:49:45.704952 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962784d-aeb0-4122-b45b-4c950b6c7037 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:45.705393 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962784d-aeb0-4122-b45b-4c950b6c7037 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:45.705767 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962784d-aeb0-4122-b45b-4c950b6c7037 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:45.707434 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 299/595] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 11:49:45.715343 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0daab-6664-4c26-92db-4544a8d6d35d None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:45.717350 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f97ae6-2cb4-4897-a59d-18477c3e290f None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:45.717893 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f97ae6-2cb4-4897-a59d-18477c3e290f None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:45.718386 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f97ae6-2cb4-4897-a59d-18477c3e290f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:45.738863 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-f5f97ae6-2cb4-4897-a59d-18477c3e290f None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:45.740569 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:45.741027 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-f5f97ae6-2cb4-4897-a59d-18477c3e290f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:45.755373 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15458008-e551-48cc-b931-3cd097d2025a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:45.756034 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15458008-e551-48cc-b931-3cd097d2025a None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:45.756314 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15458008-e551-48cc-b931-3cd097d2025a None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:45.756578 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15458008-e551-48cc-b931-3cd097d2025a None admin] PATH_INFO: `/v3/users` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:45.757703 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15458008-e551-48cc-b931-3cd097d2025a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:45.758010 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15458008-e551-48cc-b931-3cd097d2025a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:45.760334 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15458008-e551-48cc-b931-3cd097d2025a None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:45.781956 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 297/596] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Sep 21 11:49:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:45.782924 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15458008-e551-48cc-b931-3cd097d2025a None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:45.826374 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 300/597] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:49:45.827609 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f97ae6-2cb4-4897-a59d-18477c3e290f None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:45.899411 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15458008-e551-48cc-b931-3cd097d2025a None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:45.901775 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:45.943701 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4048e4-b2b3-483e-b0ef-6c4296b240e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:45.944843 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4048e4-b2b3-483e-b0ef-6c4296b240e2 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:45.945337 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4048e4-b2b3-483e-b0ef-6c4296b240e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:45.945852 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4048e4-b2b3-483e-b0ef-6c4296b240e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:45.950693 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f97ae6-2cb4-4897-a59d-18477c3e290f None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:45.958703 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4048e4-b2b3-483e-b0ef-6c4296b240e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:45.965799 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-bd4048e4-b2b3-483e-b0ef-6c4296b240e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 11:49:45.965799 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:45.965799 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:45.965799 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:45.965799 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:45.965799 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:45.965799 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:45.965799 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:45.965799 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:45.965799 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:45.965799 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:45.965799 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:45.965799 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:45.965799 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:45.965799 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:45.965799 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:45.966855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:45.966855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:45.966855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:45.966855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:45.966855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:45.966855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:45.966855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:45.966855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:45.966855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:45.966855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:45.966855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:45.966855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:45.966855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:45.966855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:45.966855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:45.966855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:45.967729 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:45.967729 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:45.967729 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:45.967729 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:45.967729 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:45.967729 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:45.967729 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:45.967729 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:45.967729 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:45.967729 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:45.967729 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 11:49:45.967729 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:45.967729 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 298/598] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 11:49:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:45.973818 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4048e4-b2b3-483e-b0ef-6c4296b240e2 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:46.002611 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3937063-d0d6-42a7-87a8-93df84225456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:46.003592 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3937063-d0d6-42a7-87a8-93df84225456 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:46.004253 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3937063-d0d6-42a7-87a8-93df84225456 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:46.004729 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3937063-d0d6-42a7-87a8-93df84225456 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:46.023958 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:46.075647 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3937063-d0d6-42a7-87a8-93df84225456 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:46.077151 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3937063-d0d6-42a7-87a8-93df84225456 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:46.090172 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4048e4-b2b3-483e-b0ef-6c4296b240e2 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:46.126733 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1bb29-5a53-4340-a974-c5db76035468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:46.127437 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1bb29-5a53-4340-a974-c5db76035468 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:46.127712 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1bb29-5a53-4340-a974-c5db76035468 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:46.127978 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1bb29-5a53-4340-a974-c5db76035468 None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:46.128707 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1bb29-5a53-4340-a974-c5db76035468 None admin] RBAC: Adding query filter params (name=service) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:46.129014 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1bb29-5a53-4340-a974-c5db76035468 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:46.130510 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1bb29-5a53-4340-a974-c5db76035468 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:46.136268 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:46.139772 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 299/599] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 11:49:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:46.145431 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1bb29-5a53-4340-a974-c5db76035468 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:46.176384 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 301/600] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:49:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:49:46.177208 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3937063-d0d6-42a7-87a8-93df84225456 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:46.245986 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1bb29-5a53-4340-a974-c5db76035468 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:46.247370 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:46.274060 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3937063-d0d6-42a7-87a8-93df84225456 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:46.279283 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae210ba1-e719-40ae-8ffe-7c491affa89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:46.279899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae210ba1-e719-40ae-8ffe-7c491affa89b None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:46.280209 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae210ba1-e719-40ae-8ffe-7c491affa89b None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:46.280479 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae210ba1-e719-40ae-8ffe-7c491affa89b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:46.291378 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae210ba1-e719-40ae-8ffe-7c491affa89b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:46.296505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-ae210ba1-e719-40ae-8ffe-7c491affa89b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 11:49:46.296505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:46.296505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:46.296505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:46.296505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:46.296505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:46.296505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:46.296505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:46.296505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:46.296505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:46.296505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:46.296505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:46.296505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:46.296505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:46.296505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:46.296505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:46.297462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:46.297462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:46.297462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:46.297462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:46.297462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:46.297462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:46.297462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:46.297462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:46.297462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:46.297462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:46.297462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:46.297462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:46.297462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:46.297462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:46.297462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:46.297462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:46.298305 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:46.298305 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:46.298305 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:46.298305 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:46.298305 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:46.298305 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:46.298305 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:46.298305 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:46.298305 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:46.298305 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:46.298305 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 11:49:46.298305 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:46.298305 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 300/601] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 11:49:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:46.298305 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae210ba1-e719-40ae-8ffe-7c491affa89b None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:46.311231 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b96c07-1c6b-4d37-b3ba-874403692bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:46.311867 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b96c07-1c6b-4d37-b3ba-874403692bdf None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:46.312163 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b96c07-1c6b-4d37-b3ba-874403692bdf None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:46.312423 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b96c07-1c6b-4d37-b3ba-874403692bdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:46.322586 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b96c07-1c6b-4d37-b3ba-874403692bdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:46.324219 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b96c07-1c6b-4d37-b3ba-874403692bdf None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:46.339125 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-01b96c07-1c6b-4d37-b3ba-874403692bdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:46.339125 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:46.339125 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:46.339125 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:46.339125 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:46.339125 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:46.339125 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:46.339125 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:46.339125 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:46.339125 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:46.339125 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:46.339125 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:46.339125 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:49:46.339125 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:49:46.339125 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:49:46.339125 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:49:46.340331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:46.340331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:46.340331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:46.340331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:46.340331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:46.340331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:46.340331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:46.340331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:46.340331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:46.340331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:46.340331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:46.340331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:46.340331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:46.340331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:46.340331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:46.340331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:46.340331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:49:46.341256 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:49:46.341256 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:46.341256 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:46.341256 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 302/602] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:46.341256 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b96c07-1c6b-4d37-b3ba-874403692bdf None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:46.358967 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:46.402348 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae210ba1-e719-40ae-8ffe-7c491affa89b None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:46.440505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828ed0a-b308-4760-ae37-1c4d2f17fdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:46.441139 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828ed0a-b308-4760-ae37-1c4d2f17fdd2 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:46.441411 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828ed0a-b308-4760-ae37-1c4d2f17fdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:46.441675 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828ed0a-b308-4760-ae37-1c4d2f17fdd2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:46.445685 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b96c07-1c6b-4d37-b3ba-874403692bdf None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:46.452264 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828ed0a-b308-4760-ae37-1c4d2f17fdd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:46.457526 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-b828ed0a-b308-4760-ae37-1c4d2f17fdd2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 11:49:46.457526 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:46.457526 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:46.457526 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:46.457526 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:46.457526 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:46.457526 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:46.457526 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:46.457526 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:46.457526 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:46.457526 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:46.457526 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:46.457526 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:46.457526 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:46.457526 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:46.457526 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:46.458545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:46.458545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:46.458545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:46.458545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:46.458545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:46.458545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:46.458545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:46.458545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:46.458545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:46.458545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:46.458545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:46.458545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:46.458545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:46.458545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:46.458545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:46.458545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:46.459399 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:46.459399 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:46.459399 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:46.459399 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:46.459399 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:46.459399 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:46.459399 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:46.459399 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:46.459399 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:46.459399 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:46.459399 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 11:49:46.459399 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:46.459399 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 301/603] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 11:49:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:46.459399 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828ed0a-b308-4760-ae37-1c4d2f17fdd2 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:46.482387 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a22e2a-c3e2-4398-bb21-159541461db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:46.483015 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a22e2a-c3e2-4398-bb21-159541461db0 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:46.483290 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a22e2a-c3e2-4398-bb21-159541461db0 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:46.483559 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a22e2a-c3e2-4398-bb21-159541461db0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:46.487949 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:46.494943 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a22e2a-c3e2-4398-bb21-159541461db0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:46.496614 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a22e2a-c3e2-4398-bb21-159541461db0 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:46.510850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-02a22e2a-c3e2-4398-bb21-159541461db0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:46.510850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:46.510850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:46.510850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:46.510850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:46.510850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:46.510850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:46.510850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:46.510850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:46.510850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:46.510850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:46.510850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:46.510850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:49:46.510850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:49:46.510850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:49:46.510850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:49:46.512050 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:46.512050 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:46.512050 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:46.512050 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:46.512050 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:46.512050 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:46.512050 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:46.512050 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:46.512050 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:46.512050 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:46.512050 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:46.512050 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:46.512050 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:46.512050 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:46.512050 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:46.512050 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:46.512050 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:49:46.513076 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:49:46.513076 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:46.513076 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:46.513076 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 303/604] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:46.513076 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a22e2a-c3e2-4398-bb21-159541461db0 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:46.569034 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828ed0a-b308-4760-ae37-1c4d2f17fdd2 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:46.582683 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:46.607942 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c45560-4c09-4567-bcb6-ad10b1e81255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:46.608578 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c45560-4c09-4567-bcb6-ad10b1e81255 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:46.608854 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c45560-4c09-4567-bcb6-ad10b1e81255 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:46.609123 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c45560-4c09-4567-bcb6-ad10b1e81255 None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:46.609778 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c45560-4c09-4567-bcb6-ad10b1e81255 None admin] RBAC: Adding query filter params (name=service) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:46.610079 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c45560-4c09-4567-bcb6-ad10b1e81255 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:46.611432 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c45560-4c09-4567-bcb6-ad10b1e81255 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:46.619474 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 302/605] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 11:49:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:46.620161 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a22e2a-c3e2-4398-bb21-159541461db0 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:46.620289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c45560-4c09-4567-bcb6-ad10b1e81255 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:46.662772 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92bd16-91d0-49a8-8be3-02c0401fea02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:46.663371 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92bd16-91d0-49a8-8be3-02c0401fea02 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:46.663655 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92bd16-91d0-49a8-8be3-02c0401fea02 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:46.664847 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92bd16-91d0-49a8-8be3-02c0401fea02 None admin] PATH_INFO: `/v3/domains` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:46.664847 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92bd16-91d0-49a8-8be3-02c0401fea02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:46.665187 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92bd16-91d0-49a8-8be3-02c0401fea02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:46.667048 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92bd16-91d0-49a8-8be3-02c0401fea02 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:46.685098 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 304/606] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:49:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:46.685918 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92bd16-91d0-49a8-8be3-02c0401fea02 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:46.710601 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:46.728090 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c45560-4c09-4567-bcb6-ad10b1e81255 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:46.763954 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b7b19-d66a-4a27-9efd-b2501d4d1ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:46.764504 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b7b19-d66a-4a27-9efd-b2501d4d1ca7 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:46.764781 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b7b19-d66a-4a27-9efd-b2501d4d1ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:46.765070 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b7b19-d66a-4a27-9efd-b2501d4d1ca7 None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:46.767035 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b7b19-d66a-4a27-9efd-b2501d4d1ca7 None admin] RBAC: Adding query filter params (name=service) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:46.767385 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b7b19-d66a-4a27-9efd-b2501d4d1ca7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:46.768840 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b7b19-d66a-4a27-9efd-b2501d4d1ca7 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:46.784302 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 303/607] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 11:49:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:46.785157 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b7b19-d66a-4a27-9efd-b2501d4d1ca7 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:46.806586 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92bd16-91d0-49a8-8be3-02c0401fea02 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:46.832817 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:46.842313 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7722b-418a-4009-9666-9f2ebae1789e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:46.842919 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7722b-418a-4009-9666-9f2ebae1789e None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:46.843195 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7722b-418a-4009-9666-9f2ebae1789e None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:46.843474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7722b-418a-4009-9666-9f2ebae1789e None admin] PATH_INFO: `/v3/domains` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:46.844159 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7722b-418a-4009-9666-9f2ebae1789e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:46.844456 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7722b-418a-4009-9666-9f2ebae1789e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:46.845819 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7722b-418a-4009-9666-9f2ebae1789e None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:46.864809 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 305/608] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:49:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:46.864809 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7722b-418a-4009-9666-9f2ebae1789e None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:46.890375 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b7b19-d66a-4a27-9efd-b2501d4d1ca7 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:46.926372 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2ec1e-f646-4a16-8a7f-06be3dcf2f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:46.926995 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2ec1e-f646-4a16-8a7f-06be3dcf2f7f None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:46.927267 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2ec1e-f646-4a16-8a7f-06be3dcf2f7f None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:46.927528 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2ec1e-f646-4a16-8a7f-06be3dcf2f7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:46.938931 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f2ec1e-f646-4a16-8a7f-06be3dcf2f7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:46.940423 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f2ec1e-f646-4a16-8a7f-06be3dcf2f7f None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:46.947411 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:46.956013 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-16f2ec1e-f646-4a16-8a7f-06be3dcf2f7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:46.956013 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:46.956013 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:46.956013 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:46.956013 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:46.956013 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:46.956013 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:46.956013 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:46.956013 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:46.956013 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:46.956013 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:46.956013 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:46.956013 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:49:46.956013 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:49:46.956013 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:49:46.956013 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:49:46.956992 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:46.956992 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:46.956992 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:46.956992 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:46.956992 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:46.956992 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:46.956992 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:46.956992 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:46.956992 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:46.956992 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:46.956992 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:46.956992 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:46.956992 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:46.956992 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:46.956992 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:46.956992 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:46.956992 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:49:46.957931 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:49:46.957931 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:46.957931 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:46.957931 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 304/609] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:46.958198 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2ec1e-f646-4a16-8a7f-06be3dcf2f7f None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:46.970115 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7722b-418a-4009-9666-9f2ebae1789e None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:47.004852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c06924-47d6-4baf-b7b5-0226efd630c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:47.005479 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c06924-47d6-4baf-b7b5-0226efd630c3 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:47.005756 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c06924-47d6-4baf-b7b5-0226efd630c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:47.006025 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c06924-47d6-4baf-b7b5-0226efd630c3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:47.015189 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c06924-47d6-4baf-b7b5-0226efd630c3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:47.016494 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c06924-47d6-4baf-b7b5-0226efd630c3 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:47.027606 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-78c06924-47d6-4baf-b7b5-0226efd630c3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 21 11:49:47.027606 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:47.027606 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:47.027606 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:47.027606 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:47.027606 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:47.027606 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:47.027606 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:47.027606 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:47.027606 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:47.027606 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:47.027606 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:47.027606 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 11:49:47.027606 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 11:49:47.027606 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 11:49:47.027606 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 11:49:47.028679 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:47.028679 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:47.028679 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 11:49:47.028679 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:49:47.028679 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 11:49:47.028679 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:49:47.028679 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:47.028679 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:47.028679 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:47.028679 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:47.028679 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:47.028679 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:47.028679 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:47.028679 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:47.028679 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:47.028679 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:47.028679 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:47.028679 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:47.029623 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:47.029623 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:47.029623 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 11:49:47.029623 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 11:49:47.029623 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 11:49:47.029623 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 11:49:47.029623 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 11:49:47.029623 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 11:49:47.029623 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 21 11:49:47.029623 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:47.029623 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 306/610] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:49:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:47.030300 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c06924-47d6-4baf-b7b5-0226efd630c3 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:47.065849 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2ec1e-f646-4a16-8a7f-06be3dcf2f7f None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:47.076581 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:47.100367 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57a087-9029-4745-89ff-577a68ddbe6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:47.100987 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57a087-9029-4745-89ff-577a68ddbe6b None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:47.101265 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57a087-9029-4745-89ff-577a68ddbe6b None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:47.101533 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57a087-9029-4745-89ff-577a68ddbe6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:47.111781 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57a087-9029-4745-89ff-577a68ddbe6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:47.113245 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57a087-9029-4745-89ff-577a68ddbe6b None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:47.127566 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-da57a087-9029-4745-89ff-577a68ddbe6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:47.127566 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:47.127566 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:47.127566 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:47.127566 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:47.127566 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:47.127566 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:47.127566 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:47.127566 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:47.127566 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:47.127566 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:47.127566 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:47.127566 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:49:47.127566 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:49:47.127566 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:49:47.127566 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:49:47.128559 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:47.128559 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:47.128559 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:47.128559 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:47.128559 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:47.128559 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:47.128559 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:47.128559 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:47.128559 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:47.128559 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:47.128559 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:47.128559 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:47.128559 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:47.128559 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:47.128559 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:47.128559 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:47.128559 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:49:47.129483 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:49:47.129483 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:47.129483 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:47.129483 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 305/611] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:47.129483 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57a087-9029-4745-89ff-577a68ddbe6b None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:47.129763 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c06924-47d6-4baf-b7b5-0226efd630c3 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:47.165640 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1307e72-b395-4951-91fa-5181b9fd4fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:47.166267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1307e72-b395-4951-91fa-5181b9fd4fe9 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:47.166538 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1307e72-b395-4951-91fa-5181b9fd4fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:47.166800 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1307e72-b395-4951-91fa-5181b9fd4fe9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:47.173572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1307e72-b395-4951-91fa-5181b9fd4fe9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:47.175001 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1307e72-b395-4951-91fa-5181b9fd4fe9 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:47.178816 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:47.186967 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-e1307e72-b395-4951-91fa-5181b9fd4fe9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:49:47.186967 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:47.186967 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:47.186967 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:47.186967 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:47.186967 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:47.186967 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:47.186967 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:47.186967 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:47.186967 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:47.186967 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:47.186967 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:47.186967 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 11:49:47.186967 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 11:49:47.186967 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 11:49:47.187883 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 11:49:47.187883 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:47.187883 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:47.187883 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:47.187883 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:47.187883 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:47.187883 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:47.187883 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:47.187883 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:47.187883 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:47.187883 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:47.187883 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:47.187883 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:47.187883 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:47.187883 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:47.187883 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:47.187883 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:47.188963 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 11:49:47.188963 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 11:49:47.188963 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 11:49:47.188963 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 11:49:47.188963 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 11:49:47.188963 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 11:49:47.188963 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:49:47.188963 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:47.188963 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 307/612] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:49:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:47.189456 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1307e72-b395-4951-91fa-5181b9fd4fe9 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:47.234258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57a087-9029-4745-89ff-577a68ddbe6b None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:47.268017 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06b34a-553a-4c3f-9eba-7a3c349062ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:47.268550 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06b34a-553a-4c3f-9eba-7a3c349062ac None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:47.268824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06b34a-553a-4c3f-9eba-7a3c349062ac None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:47.269090 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06b34a-553a-4c3f-9eba-7a3c349062ac None admin] PATH_INFO: `/v3/domains` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:47.269724 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06b34a-553a-4c3f-9eba-7a3c349062ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:47.270018 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06b34a-553a-4c3f-9eba-7a3c349062ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:47.271376 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06b34a-553a-4c3f-9eba-7a3c349062ac None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:47.283375 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 306/613] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:49:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:47.284204 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06b34a-553a-4c3f-9eba-7a3c349062ac None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:47.290923 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1307e72-b395-4951-91fa-5181b9fd4fe9 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:47.299051 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:47.325626 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a186a0e-a85c-469f-b2a7-be9403182a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:47.326270 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a186a0e-a85c-469f-b2a7-be9403182a95 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:47.326481 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a186a0e-a85c-469f-b2a7-be9403182a95 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:47.326744 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a186a0e-a85c-469f-b2a7-be9403182a95 None admin] PATH_INFO: `/v3/users` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:47.327461 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a186a0e-a85c-469f-b2a7-be9403182a95 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:47.327762 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a186a0e-a85c-469f-b2a7-be9403182a95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:47.329212 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a186a0e-a85c-469f-b2a7-be9403182a95 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:47.350978 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 308/614] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Sep 21 11:49:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:47.350978 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a186a0e-a85c-469f-b2a7-be9403182a95 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:47.384782 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06b34a-553a-4c3f-9eba-7a3c349062ac None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:47.395135 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:47.419220 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0a40e-7ea2-4d96-a1d3-6c0ba7eec80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:47.419857 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0a40e-7ea2-4d96-a1d3-6c0ba7eec80d None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:47.420110 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0a40e-7ea2-4d96-a1d3-6c0ba7eec80d None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:47.420386 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0a40e-7ea2-4d96-a1d3-6c0ba7eec80d None admin] PATH_INFO: `/v3/domains` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:47.421021 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0a40e-7ea2-4d96-a1d3-6c0ba7eec80d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:47.421319 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0a40e-7ea2-4d96-a1d3-6c0ba7eec80d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:47.422685 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0a40e-7ea2-4d96-a1d3-6c0ba7eec80d None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:47.434232 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 307/615] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:49:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:47.435017 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0a40e-7ea2-4d96-a1d3-6c0ba7eec80d None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:47.448815 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a186a0e-a85c-469f-b2a7-be9403182a95 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:47.483023 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a526e-51d0-4de7-b605-fb2cf3a072b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:47.483736 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a526e-51d0-4de7-b605-fb2cf3a072b8 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:47.483984 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a526e-51d0-4de7-b605-fb2cf3a072b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:47.484279 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a526e-51d0-4de7-b605-fb2cf3a072b8 None admin] PATH_INFO: `/v3/projects` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:47.484956 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a526e-51d0-4de7-b605-fb2cf3a072b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:47.485255 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a526e-51d0-4de7-b605-fb2cf3a072b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:47.486657 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a526e-51d0-4de7-b605-fb2cf3a072b8 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:47.498399 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 309/616] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 11:49:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:47.499202 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a526e-51d0-4de7-b605-fb2cf3a072b8 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:47.526023 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:47.535135 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0a40e-7ea2-4d96-a1d3-6c0ba7eec80d None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:47.567571 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c63e5-5746-40ff-b2fd-f4aebf191c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:47.568220 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c63e5-5746-40ff-b2fd-f4aebf191c22 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:47.568506 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c63e5-5746-40ff-b2fd-f4aebf191c22 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:47.568766 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c63e5-5746-40ff-b2fd-f4aebf191c22 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:47.579223 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c63e5-5746-40ff-b2fd-f4aebf191c22 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:47.579223 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c63e5-5746-40ff-b2fd-f4aebf191c22 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:47.593110 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-7d6c63e5-5746-40ff-b2fd-f4aebf191c22 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 11:49:47.593110 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:47.593110 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:47.593110 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:47.593110 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:47.593110 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:47.593110 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:47.593110 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:47.593110 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:47.593110 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:47.593110 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:47.593110 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:47.593110 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 11:49:47.593110 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 11:49:47.593110 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 11:49:47.593110 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 11:49:47.594258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:47.594258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:47.594258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 11:49:47.594258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:49:47.594258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 11:49:47.594258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:49:47.594258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:47.594258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:47.594258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:47.594258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:47.594258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:47.594258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:47.594258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:47.594258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:47.594258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:47.594258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:47.594258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:47.594258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:47.595267 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:47.595267 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:47.595267 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 11:49:47.595267 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 11:49:47.595267 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 11:49:47.595267 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 11:49:47.595267 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 11:49:47.595267 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 11:49:47.595267 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 11:49:47.595267 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:47.595267 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 308/617] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:49:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:47.595267 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c63e5-5746-40ff-b2fd-f4aebf191c22 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:47.607524 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a526e-51d0-4de7-b605-fb2cf3a072b8 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:47.625986 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:47.641081 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1dbac-ec44-434f-85dd-53ffaa1e6537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:47.641677 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1dbac-ec44-434f-85dd-53ffaa1e6537 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:47.641947 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1dbac-ec44-434f-85dd-53ffaa1e6537 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:47.642208 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1dbac-ec44-434f-85dd-53ffaa1e6537 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:47.697565 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c63e5-5746-40ff-b2fd-f4aebf191c22 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:47.714510 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1dbac-ec44-434f-85dd-53ffaa1e6537 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:47.716253 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1dbac-ec44-434f-85dd-53ffaa1e6537 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:47.731024 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ea5a0-fc7e-4c29-bd5d-5b83e0d5d310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:47.731638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ea5a0-fc7e-4c29-bd5d-5b83e0d5d310 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:47.731906 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ea5a0-fc7e-4c29-bd5d-5b83e0d5d310 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:47.732209 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ea5a0-fc7e-4c29-bd5d-5b83e0d5d310 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:47.739635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ea5a0-fc7e-4c29-bd5d-5b83e0d5d310 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:47.741105 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ea5a0-fc7e-4c29-bd5d-5b83e0d5d310 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:47.741805 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:47.753956 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-e36ea5a0-fc7e-4c29-bd5d-5b83e0d5d310 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 21 11:49:47.753956 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:47.753956 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:47.753956 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:47.753956 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:47.753956 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:47.753956 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:47.753956 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:47.753956 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:47.753956 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:47.753956 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:47.753956 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:47.753956 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 11:49:47.753956 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 11:49:47.753956 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 11:49:47.753956 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 11:49:47.755041 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:47.755041 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:47.755041 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 11:49:47.755041 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:49:47.755041 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 11:49:47.755041 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:49:47.755041 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:47.755041 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:47.755041 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:47.755041 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:47.755041 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:47.755041 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:47.755041 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:47.755041 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:47.755041 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:47.755041 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:47.755041 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:47.755041 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:47.756500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:47.756500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:47.756500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 11:49:47.756500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 11:49:47.756500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 11:49:47.756500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 11:49:47.756500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 11:49:47.756500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 11:49:47.756500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 21 11:49:47.756500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:47.756500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 309/618] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 11:49:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:47.756500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ea5a0-fc7e-4c29-bd5d-5b83e0d5d310 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:47.827639 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 310/619] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:49:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:49:47.828883 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1dbac-ec44-434f-85dd-53ffaa1e6537 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:47.856091 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:47.866855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ea5a0-fc7e-4c29-bd5d-5b83e0d5d310 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:47.902615 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76268304-a863-4053-8864-e7d3285a9bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:47.903161 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76268304-a863-4053-8864-e7d3285a9bcd None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:47.903434 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76268304-a863-4053-8864-e7d3285a9bcd None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:47.903704 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76268304-a863-4053-8864-e7d3285a9bcd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:47.904462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76268304-a863-4053-8864-e7d3285a9bcd None admin] RBAC: Adding query filter params (role.id=1557d254ce394d9e8d83e9c55cc20445, scope.project.id=1fd87b195f7c46d2a0d621124acce331, user.id=c683dcd33e5b40fabbbf12c3dcf97eb1) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:47.904765 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76268304-a863-4053-8864-e7d3285a9bcd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:47.906207 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76268304-a863-4053-8864-e7d3285a9bcd None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:47.912012 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 310/620] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 11:49:47 2022] GET /identity/v3/role_assignments?user.id=c683dcd33e5b40fabbbf12c3dcf97eb1&scope.project.id=1fd87b195f7c46d2a0d621124acce331&role.id=1557d254ce394d9e8d83e9c55cc20445 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:47.912012 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76268304-a863-4053-8864-e7d3285a9bcd None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:47.939768 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1dbac-ec44-434f-85dd-53ffaa1e6537 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:47.969535 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:47.984468 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193f276-8817-4d4f-a0e4-0a6ba59ba390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:47.985097 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193f276-8817-4d4f-a0e4-0a6ba59ba390 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:47.985377 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193f276-8817-4d4f-a0e4-0a6ba59ba390 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:47.985649 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193f276-8817-4d4f-a0e4-0a6ba59ba390 None admin] PATH_INFO: `/v3/users` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:47.986399 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193f276-8817-4d4f-a0e4-0a6ba59ba390 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:47.986705 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193f276-8817-4d4f-a0e4-0a6ba59ba390 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:47.988229 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193f276-8817-4d4f-a0e4-0a6ba59ba390 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:48.011073 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 311/621] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Sep 21 11:49:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:48.011796 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193f276-8817-4d4f-a0e4-0a6ba59ba390 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:48.055744 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76268304-a863-4053-8864-e7d3285a9bcd None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:48.093567 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ee14c-bff2-41fe-a0e1-5212dc545ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:48.094091 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ee14c-bff2-41fe-a0e1-5212dc545ae8 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:48.094433 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ee14c-bff2-41fe-a0e1-5212dc545ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:48.094710 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ee14c-bff2-41fe-a0e1-5212dc545ae8 None admin] PATH_INFO: `/v3/users` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:48.095452 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ee14c-bff2-41fe-a0e1-5212dc545ae8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:48.095756 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ee14c-bff2-41fe-a0e1-5212dc545ae8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:48.097630 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ee14c-bff2-41fe-a0e1-5212dc545ae8 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:48.116639 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 311/622] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Sep 21 11:49:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:48.117480 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ee14c-bff2-41fe-a0e1-5212dc545ae8 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:48.133417 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193f276-8817-4d4f-a0e4-0a6ba59ba390 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:48.136708 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:48.181142 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca934a3-2c55-4974-9028-487c5d4e93af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:48.181993 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca934a3-2c55-4974-9028-487c5d4e93af None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:48.182281 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca934a3-2c55-4974-9028-487c5d4e93af None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:48.182825 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca934a3-2c55-4974-9028-487c5d4e93af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:48.193692 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca934a3-2c55-4974-9028-487c5d4e93af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:48.195254 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca934a3-2c55-4974-9028-487c5d4e93af None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:48.210806 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-bca934a3-2c55-4974-9028-487c5d4e93af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:48.210806 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:48.210806 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:48.210806 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:48.210806 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:48.210806 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:48.210806 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:48.210806 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:48.210806 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:48.210806 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:48.210806 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:48.210806 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:48.210806 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:49:48.210806 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:49:48.210806 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:49:48.210806 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:49:48.211844 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:48.211844 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:48.211844 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:48.211844 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:48.211844 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:48.211844 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:48.211844 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:48.211844 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:48.211844 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:48.211844 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:48.211844 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:48.211844 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:48.211844 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:48.211844 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:48.211844 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:48.211844 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:48.211844 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:49:48.212838 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:49:48.212838 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:48.212838 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:48.212838 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 312/623] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:48.213076 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca934a3-2c55-4974-9028-487c5d4e93af None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:48.237160 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ee14c-bff2-41fe-a0e1-5212dc545ae8 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:48.253101 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:48.272864 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04e58a-d27d-4e89-9652-2b836704977f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:48.273473 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04e58a-d27d-4e89-9652-2b836704977f None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:48.273749 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04e58a-d27d-4e89-9652-2b836704977f None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:48.274078 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04e58a-d27d-4e89-9652-2b836704977f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:48.325121 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca934a3-2c55-4974-9028-487c5d4e93af None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:48.352797 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04e58a-d27d-4e89-9652-2b836704977f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:48.354498 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04e58a-d27d-4e89-9652-2b836704977f None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:48.361168 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d1916-6145-4ba2-9108-3725f22e1661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:48.361796 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d1916-6145-4ba2-9108-3725f22e1661 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:48.362339 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d1916-6145-4ba2-9108-3725f22e1661 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:48.362339 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d1916-6145-4ba2-9108-3725f22e1661 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:48.373426 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:48.440587 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d1916-6145-4ba2-9108-3725f22e1661 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:48.442047 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d1916-6145-4ba2-9108-3725f22e1661 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:48.471448 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 312/624] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:49:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:49:48.472335 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04e58a-d27d-4e89-9652-2b836704977f None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:48.485269 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:48.566242 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 313/625] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:49:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:49:48.566242 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d1916-6145-4ba2-9108-3725f22e1661 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:48.587456 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04e58a-d27d-4e89-9652-2b836704977f None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:48.601529 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:48.623857 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075beacb-e2b2-4920-b583-3513ff2d4d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:48.624492 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075beacb-e2b2-4920-b583-3513ff2d4d9f None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:48.624776 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075beacb-e2b2-4920-b583-3513ff2d4d9f None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:48.625047 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075beacb-e2b2-4920-b583-3513ff2d4d9f None admin] PATH_INFO: `/v3/domains` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:48.625682 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075beacb-e2b2-4920-b583-3513ff2d4d9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:48.625980 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075beacb-e2b2-4920-b583-3513ff2d4d9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:48.627351 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075beacb-e2b2-4920-b583-3513ff2d4d9f None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:48.639078 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 313/626] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:48.639951 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075beacb-e2b2-4920-b583-3513ff2d4d9f None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:48.679583 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d1916-6145-4ba2-9108-3725f22e1661 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:48.718606 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9b630-5cb2-4568-adf9-0d810b4e2008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:48.719230 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9b630-5cb2-4568-adf9-0d810b4e2008 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:48.719504 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9b630-5cb2-4568-adf9-0d810b4e2008 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:48.719771 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9b630-5cb2-4568-adf9-0d810b4e2008 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:48.721650 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:48.731416 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9b630-5cb2-4568-adf9-0d810b4e2008 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:48.733001 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9b630-5cb2-4568-adf9-0d810b4e2008 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:48.747641 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-52c9b630-5cb2-4568-adf9-0d810b4e2008 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:48.747641 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:48.747641 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:48.747641 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:48.747641 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:48.747641 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:48.747641 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:48.747641 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:48.747641 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:48.747641 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:48.747641 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:48.747641 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:48.747641 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:49:48.747641 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:49:48.747641 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:49:48.747641 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:49:48.748677 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:48.748677 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:48.748677 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:48.748677 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:48.748677 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:48.748677 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:48.748677 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:48.748677 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:48.748677 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:48.748677 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:48.748677 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:48.748677 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:48.748677 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:48.748677 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:48.748677 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:48.748677 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:48.748677 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:49:48.754425 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:49:48.754425 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:48.754425 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:48.754425 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 314/627] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:48.754425 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9b630-5cb2-4568-adf9-0d810b4e2008 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:48.760149 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075beacb-e2b2-4920-b583-3513ff2d4d9f None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:48.797580 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed31ec-1c49-4144-b269-5a06bad104a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:48.798192 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed31ec-1c49-4144-b269-5a06bad104a0 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:48.798471 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed31ec-1c49-4144-b269-5a06bad104a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:48.798740 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed31ec-1c49-4144-b269-5a06bad104a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:48.809103 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed31ec-1c49-4144-b269-5a06bad104a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:48.810548 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed31ec-1c49-4144-b269-5a06bad104a0 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:48.828494 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-56ed31ec-1c49-4144-b269-5a06bad104a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:48.828494 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:48.828494 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:48.828494 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:48.828494 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:48.828494 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:48.828494 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:48.828494 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:48.828494 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:48.828494 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:48.828494 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:48.828494 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:48.828494 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:49:48.828494 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:49:48.828494 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:49:48.828494 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:49:48.829503 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:48.829503 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:48.829503 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:48.829503 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:48.829503 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:48.829503 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:48.829503 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:48.829503 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:48.829503 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:48.829503 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:48.829503 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:48.829503 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:48.829503 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:48.829503 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:48.829503 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:48.829503 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:48.829503 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:49:48.835374 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:49:48.835374 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:48.835374 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:48.835374 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 314/628] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:48.835374 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed31ec-1c49-4144-b269-5a06bad104a0 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:48.861073 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9b630-5cb2-4568-adf9-0d810b4e2008 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:48.864883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:48.899687 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ab2ce-60f9-4ea8-b9c7-39827a44d889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:48.900271 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ab2ce-60f9-4ea8-b9c7-39827a44d889 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:48.900534 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ab2ce-60f9-4ea8-b9c7-39827a44d889 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:48.900796 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ab2ce-60f9-4ea8-b9c7-39827a44d889 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:48.907945 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ab2ce-60f9-4ea8-b9c7-39827a44d889 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:48.909645 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ab2ce-60f9-4ea8-b9c7-39827a44d889 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:48.921383 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-ec0ab2ce-60f9-4ea8-b9c7-39827a44d889 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:49:48.921383 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:48.921383 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:48.921383 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:48.921383 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:48.921383 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:48.921383 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:48.921383 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:48.921383 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:48.921383 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:48.921383 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:48.921383 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:48.921383 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 11:49:48.921383 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 11:49:48.921383 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 11:49:48.922502 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 11:49:48.922502 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:48.922502 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:48.922502 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:48.922502 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:48.922502 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:48.922502 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:48.922502 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:48.922502 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:48.922502 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:48.922502 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:48.922502 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:48.922502 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:48.922502 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:48.922502 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:48.922502 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:48.922502 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:48.923413 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 11:49:48.923413 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 11:49:48.923413 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 11:49:48.923413 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 11:49:48.923413 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 11:49:48.923413 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 11:49:48.923413 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:49:48.923413 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:48.923413 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 315/629] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:49:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:48.924554 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ab2ce-60f9-4ea8-b9c7-39827a44d889 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:48.948776 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed31ec-1c49-4144-b269-5a06bad104a0 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:48.977322 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:48.984590 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754e22b-3e32-4a32-9032-d0e163f79229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:48.985186 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754e22b-3e32-4a32-9032-d0e163f79229 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:48.985536 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754e22b-3e32-4a32-9032-d0e163f79229 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:48.985797 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754e22b-3e32-4a32-9032-d0e163f79229 None admin] PATH_INFO: `/v3/domains` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:48.986360 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4754e22b-3e32-4a32-9032-d0e163f79229 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:48.986661 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4754e22b-3e32-4a32-9032-d0e163f79229 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:48.988128 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4754e22b-3e32-4a32-9032-d0e163f79229 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:49.004482 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 315/630] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:49.004482 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754e22b-3e32-4a32-9032-d0e163f79229 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:49.042181 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ab2ce-60f9-4ea8-b9c7-39827a44d889 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:49.080816 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba8a87-40b3-4111-9f68-8282da684547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:49.081715 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba8a87-40b3-4111-9f68-8282da684547 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:49.082449 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba8a87-40b3-4111-9f68-8282da684547 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:49.082449 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba8a87-40b3-4111-9f68-8282da684547 None admin] PATH_INFO: `/v3/domains` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:49.082893 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba8a87-40b3-4111-9f68-8282da684547 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:49.083196 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba8a87-40b3-4111-9f68-8282da684547 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:49.084596 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba8a87-40b3-4111-9f68-8282da684547 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:49.099019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 316/631] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:49.099864 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba8a87-40b3-4111-9f68-8282da684547 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:49.105494 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:49.123106 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754e22b-3e32-4a32-9032-d0e163f79229 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:49.158378 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783447a-d798-426f-b4c8-9752d2ee70bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:49.158888 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783447a-d798-426f-b4c8-9752d2ee70bd None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:49.159158 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783447a-d798-426f-b4c8-9752d2ee70bd None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:49.159421 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783447a-d798-426f-b4c8-9752d2ee70bd None admin] PATH_INFO: `/v3/projects` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:49.160126 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5783447a-d798-426f-b4c8-9752d2ee70bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:49.160423 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5783447a-d798-426f-b4c8-9752d2ee70bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:49.161840 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5783447a-d798-426f-b4c8-9752d2ee70bd None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:49.173739 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 316/632] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 11:49:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:49.174442 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783447a-d798-426f-b4c8-9752d2ee70bd None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:49.212158 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba8a87-40b3-4111-9f68-8282da684547 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:49.220079 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:49.250874 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18841462-4fb7-4bc9-a9ed-24dc666ea607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:49.251496 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18841462-4fb7-4bc9-a9ed-24dc666ea607 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:49.251769 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18841462-4fb7-4bc9-a9ed-24dc666ea607 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:49.252056 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18841462-4fb7-4bc9-a9ed-24dc666ea607 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:49.260168 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18841462-4fb7-4bc9-a9ed-24dc666ea607 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:49.261713 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18841462-4fb7-4bc9-a9ed-24dc666ea607 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:49.275776 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-18841462-4fb7-4bc9-a9ed-24dc666ea607 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:49:49.275776 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:49.275776 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:49.275776 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:49.275776 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:49.275776 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:49.275776 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:49.275776 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:49.275776 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:49.275776 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:49.275776 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:49.275776 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:49.275776 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 11:49:49.275776 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 11:49:49.275776 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 11:49:49.276922 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 11:49:49.276922 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:49.276922 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:49.276922 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:49.276922 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:49.276922 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:49.276922 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:49.276922 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:49.276922 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:49.276922 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:49.276922 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:49.276922 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:49.276922 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:49.276922 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:49.276922 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:49.276922 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:49.276922 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:49.278074 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 11:49:49.278074 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 11:49:49.278074 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 11:49:49.278074 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 11:49:49.278074 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 11:49:49.278074 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 11:49:49.278074 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:49:49.278074 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:49.280116 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 317/633] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:49:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:49.281055 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783447a-d798-426f-b4c8-9752d2ee70bd None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:49.281265 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18841462-4fb7-4bc9-a9ed-24dc666ea607 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:49.319273 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a744604-bbc3-4a34-aa52-2c8145bf6ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:49.320096 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a744604-bbc3-4a34-aa52-2c8145bf6ce1 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:49.320466 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a744604-bbc3-4a34-aa52-2c8145bf6ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:49.321434 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a744604-bbc3-4a34-aa52-2c8145bf6ce1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:49.328280 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a744604-bbc3-4a34-aa52-2c8145bf6ce1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:49.329745 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a744604-bbc3-4a34-aa52-2c8145bf6ce1 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:49.340809 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-4a744604-bbc3-4a34-aa52-2c8145bf6ce1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:49:49.340809 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:49.340809 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:49.340809 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:49.340809 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:49.340809 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:49.340809 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:49.340809 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:49.340809 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:49.340809 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:49.340809 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:49.340809 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:49.340809 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 11:49:49.340809 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 11:49:49.340809 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 11:49:49.341880 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 11:49:49.341880 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:49.341880 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:49.341880 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:49.341880 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:49.341880 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:49.341880 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:49.341880 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:49.341880 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:49.341880 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:49.341880 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:49.341880 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:49.341880 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:49.341880 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:49.341880 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:49.341880 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:49.341880 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:49.342990 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 11:49:49.342990 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 11:49:49.342990 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 11:49:49.342990 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 11:49:49.342990 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 11:49:49.342990 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 11:49:49.342990 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:49:49.342990 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:49.342990 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 317/634] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:49:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:49.342990 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a744604-bbc3-4a34-aa52-2c8145bf6ce1 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:49.348409 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:49.393591 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18841462-4fb7-4bc9-a9ed-24dc666ea607 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:49.434484 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc54f91-fffc-420d-84d7-ba54598ce413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:49.434999 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc54f91-fffc-420d-84d7-ba54598ce413 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:49.435274 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc54f91-fffc-420d-84d7-ba54598ce413 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:49.435542 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc54f91-fffc-420d-84d7-ba54598ce413 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:49.436304 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc54f91-fffc-420d-84d7-ba54598ce413 None admin] RBAC: Adding query filter params (role.id=1557d254ce394d9e8d83e9c55cc20445, scope.project.id=1fd87b195f7c46d2a0d621124acce331, user.id=f4e6b7bc6eea49ba9f54b0305f3173b0) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:49.436627 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc54f91-fffc-420d-84d7-ba54598ce413 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:49.438071 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc54f91-fffc-420d-84d7-ba54598ce413 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:49.443830 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 318/635] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 11:49:49 2022] GET /identity/v3/role_assignments?user.id=f4e6b7bc6eea49ba9f54b0305f3173b0&scope.project.id=1fd87b195f7c46d2a0d621124acce331&role.id=1557d254ce394d9e8d83e9c55cc20445 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:49.444654 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc54f91-fffc-420d-84d7-ba54598ce413 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:49.473398 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a744604-bbc3-4a34-aa52-2c8145bf6ce1 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:49.481868 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:49.526086 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bf651-02ff-4fc3-9fbd-e5b2faa79336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:49.527241 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bf651-02ff-4fc3-9fbd-e5b2faa79336 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:49.527914 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bf651-02ff-4fc3-9fbd-e5b2faa79336 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:49.528371 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bf651-02ff-4fc3-9fbd-e5b2faa79336 None admin] PATH_INFO: `/v3/projects` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:49.529910 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12bf651-02ff-4fc3-9fbd-e5b2faa79336 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:49.530407 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12bf651-02ff-4fc3-9fbd-e5b2faa79336 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:49.533068 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12bf651-02ff-4fc3-9fbd-e5b2faa79336 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:49.550785 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 318/636] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 11:49:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:49.564044 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bf651-02ff-4fc3-9fbd-e5b2faa79336 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:49.585569 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc54f91-fffc-420d-84d7-ba54598ce413 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:49.630401 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c44792-c1e4-4cc4-accf-b9e5faabe117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:49.631274 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c44792-c1e4-4cc4-accf-b9e5faabe117 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:49.631739 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c44792-c1e4-4cc4-accf-b9e5faabe117 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:49.632179 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c44792-c1e4-4cc4-accf-b9e5faabe117 None admin] PATH_INFO: `/v3/projects` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:49.633104 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c44792-c1e4-4cc4-accf-b9e5faabe117 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:49.633602 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c44792-c1e4-4cc4-accf-b9e5faabe117 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:49.635217 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c44792-c1e4-4cc4-accf-b9e5faabe117 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:49.644865 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:49.649876 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 319/637] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 11:49:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:49.655379 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c44792-c1e4-4cc4-accf-b9e5faabe117 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:49.703825 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bf651-02ff-4fc3-9fbd-e5b2faa79336 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:49.749981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd53b7-b26f-4cd6-80d1-87eb7fbe50e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:49.751816 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd53b7-b26f-4cd6-80d1-87eb7fbe50e1 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:49.752421 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd53b7-b26f-4cd6-80d1-87eb7fbe50e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:49.752698 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd53b7-b26f-4cd6-80d1-87eb7fbe50e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:49.753447 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd53b7-b26f-4cd6-80d1-87eb7fbe50e1 None admin] RBAC: Adding query filter params (role.id=1557d254ce394d9e8d83e9c55cc20445, scope.project.id=1fd87b195f7c46d2a0d621124acce331, user.id=75426336bd2d443fbe3f2dd97293fc15) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:49.753760 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd53b7-b26f-4cd6-80d1-87eb7fbe50e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:49.755307 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd53b7-b26f-4cd6-80d1-87eb7fbe50e1 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:49.762323 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 319/638] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 11:49:49 2022] GET /identity/v3/role_assignments?user.id=75426336bd2d443fbe3f2dd97293fc15&scope.project.id=1fd87b195f7c46d2a0d621124acce331&role.id=1557d254ce394d9e8d83e9c55cc20445 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:49:49.781832 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:49.796029 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c44792-c1e4-4cc4-accf-b9e5faabe117 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:49.840330 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5613e2-88fd-4878-ac71-0aa14c61697d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:49.841233 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5613e2-88fd-4878-ac71-0aa14c61697d None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:49.841663 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5613e2-88fd-4878-ac71-0aa14c61697d None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:49.842087 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5613e2-88fd-4878-ac71-0aa14c61697d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:49.843020 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5613e2-88fd-4878-ac71-0aa14c61697d None admin] RBAC: Adding query filter params (role.id=1557d254ce394d9e8d83e9c55cc20445, scope.project.id=1fd87b195f7c46d2a0d621124acce331, user.id=1cf371d784014c68a9ff4c301dad5ca9) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:49.843499 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5613e2-88fd-4878-ac71-0aa14c61697d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:49.845164 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5613e2-88fd-4878-ac71-0aa14c61697d None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:49.853088 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 320/639] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 11:49:49 2022] GET /identity/v3/role_assignments?user.id=1cf371d784014c68a9ff4c301dad5ca9&scope.project.id=1fd87b195f7c46d2a0d621124acce331&role.id=1557d254ce394d9e8d83e9c55cc20445 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:49:50.451077 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3845729-9146-4456-aec4-2edc79d6ae11 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:50.451484 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3845729-9146-4456-aec4-2edc79d6ae11 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:50.451664 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3845729-9146-4456-aec4-2edc79d6ae11 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:50.453288 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 320/640] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:50.458809 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc9380-4405-469b-8d49-4ef664bac124 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:50.459660 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc9380-4405-469b-8d49-4ef664bac124 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:50.460183 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc9380-4405-469b-8d49-4ef664bac124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:50.479650 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-93cc9380-4405-469b-8d49-4ef664bac124 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:50.481196 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-93cc9380-4405-469b-8d49-4ef664bac124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:50.559022 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 321/641] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:49:50.888735 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3845729-9146-4456-aec4-2edc79d6ae11 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:50.999851 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3845729-9146-4456-aec4-2edc79d6ae11 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:51.027319 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:51.036113 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f98b3-c483-4d89-976d-f20f4920f320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:51.036732 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f98b3-c483-4d89-976d-f20f4920f320 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:51.037002 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f98b3-c483-4d89-976d-f20f4920f320 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:51.037266 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f98b3-c483-4d89-976d-f20f4920f320 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:51.049029 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f98b3-c483-4d89-976d-f20f4920f320 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:51.053926 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-096f98b3-c483-4d89-976d-f20f4920f320 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:49:51.053926 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:51.053926 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:51.053926 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:51.053926 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:51.053926 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:51.053926 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:51.053926 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:51.053926 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:51.053926 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:51.053926 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:51.053926 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:51.053926 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:51.053926 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:51.053926 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:51.053926 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:51.055057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:51.055057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:51.055057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:51.055057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:51.055057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:51.055057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:51.055057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:51.055057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:51.055057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:51.055057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:51.055057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:51.055057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:51.055057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:51.055057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:51.055057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:51.055057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:51.056042 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:51.056042 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:51.056042 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:51.056042 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:51.056042 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:51.056042 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:51.056042 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:51.056042 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:51.056042 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:51.056042 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:51.056042 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:49:51.056042 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:51.056042 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 321/642] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 11:49:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:51.063303 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc9380-4405-469b-8d49-4ef664bac124 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:51.156680 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:51.174385 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc9380-4405-469b-8d49-4ef664bac124 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:51.213032 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e172db-54d5-4077-9e08-d7d37832431a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:51.213640 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e172db-54d5-4077-9e08-d7d37832431a None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:51.213915 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e172db-54d5-4077-9e08-d7d37832431a None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:51.214183 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e172db-54d5-4077-9e08-d7d37832431a None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:51.214844 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e172db-54d5-4077-9e08-d7d37832431a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:51.215144 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e172db-54d5-4077-9e08-d7d37832431a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:51.216537 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e172db-54d5-4077-9e08-d7d37832431a None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:51.225582 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 322/643] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:49:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:51.231108 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f98b3-c483-4d89-976d-f20f4920f320 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:51.335487 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f98b3-c483-4d89-976d-f20f4920f320 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:51.370156 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c5964-b312-4699-92d2-0ec14bdb75e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:51.370779 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c5964-b312-4699-92d2-0ec14bdb75e9 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:51.371048 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c5964-b312-4699-92d2-0ec14bdb75e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:51.371312 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c5964-b312-4699-92d2-0ec14bdb75e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:51.383584 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c5964-b312-4699-92d2-0ec14bdb75e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:51.385058 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c5964-b312-4699-92d2-0ec14bdb75e9 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:51.399655 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-9e6c5964-b312-4699-92d2-0ec14bdb75e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:51.399655 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:51.399655 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:51.399655 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:51.399655 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:51.399655 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:51.399655 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:51.399655 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:51.399655 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:51.399655 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:51.399655 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:51.399655 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:51.399655 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:49:51.399655 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:49:51.399655 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:49:51.399655 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:49:51.401132 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:51.401132 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:51.401132 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:51.401132 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:51.401132 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:51.401132 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:51.401132 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:51.401132 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:51.401132 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:51.401132 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:51.401132 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:51.401132 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:51.401132 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:51.401132 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:51.401132 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:51.401132 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:51.401132 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:49:51.402460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:49:51.402460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:51.402460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:51.402460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 322/644] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:51.409049 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e172db-54d5-4077-9e08-d7d37832431a None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:51.519196 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e172db-54d5-4077-9e08-d7d37832431a None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:51.554104 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c650bf-31b5-4351-bc5c-eb9c4f64808e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:51.554706 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c650bf-31b5-4351-bc5c-eb9c4f64808e None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:51.555519 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c650bf-31b5-4351-bc5c-eb9c4f64808e None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:51.555794 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c650bf-31b5-4351-bc5c-eb9c4f64808e None admin] PATH_INFO: `/v3/domains` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:51.556455 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c650bf-31b5-4351-bc5c-eb9c4f64808e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:51.556758 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c650bf-31b5-4351-bc5c-eb9c4f64808e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:51.558120 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c650bf-31b5-4351-bc5c-eb9c4f64808e None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:51.571158 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 323/645] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:51.576769 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c5964-b312-4699-92d2-0ec14bdb75e9 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:51.634057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:51.697178 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c5964-b312-4699-92d2-0ec14bdb75e9 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:51.732240 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e543ff-a7e7-4a37-9b23-bc601b5b2c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:51.732855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e543ff-a7e7-4a37-9b23-bc601b5b2c3e None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:51.733128 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e543ff-a7e7-4a37-9b23-bc601b5b2c3e None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:51.733445 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e543ff-a7e7-4a37-9b23-bc601b5b2c3e None admin] PATH_INFO: `/v3/users/nova` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:51.741250 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e543ff-a7e7-4a37-9b23-bc601b5b2c3e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:51.743378 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e543ff-a7e7-4a37-9b23-bc601b5b2c3e None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:51.754515 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-79e543ff-a7e7-4a37-9b23-bc601b5b2c3e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 11:49:51.754515 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:51.754515 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:51.754515 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:51.754515 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:51.754515 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:51.754515 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:51.754515 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:51.754515 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:51.754515 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:51.754515 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:51.754515 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:51.754515 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 11:49:51.754515 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 11:49:51.754515 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 11:49:51.754515 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 11:49:51.755498 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:51.755498 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:51.755498 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 11:49:51.755498 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:49:51.755498 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 11:49:51.755498 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:49:51.755498 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:51.755498 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:51.755498 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:51.755498 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:51.755498 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:51.755498 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:51.755498 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:51.755498 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:51.755498 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:51.755498 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:51.755498 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:51.755498 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:51.756504 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:51.756504 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:51.756504 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 11:49:51.756504 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 11:49:51.756504 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 11:49:51.756504 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 11:49:51.756504 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 11:49:51.756504 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 11:49:51.756504 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 11:49:51.756504 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:51.756504 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 323/646] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Sep 21 11:49:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:51.763505 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c650bf-31b5-4351-bc5c-eb9c4f64808e None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:51.772614 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:51.877287 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c650bf-31b5-4351-bc5c-eb9c4f64808e None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:51.918606 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1420bde-a50f-4b5b-aed0-a4d246fee5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:51.919294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1420bde-a50f-4b5b-aed0-a4d246fee5a2 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:51.919615 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1420bde-a50f-4b5b-aed0-a4d246fee5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:51.919884 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1420bde-a50f-4b5b-aed0-a4d246fee5a2 None admin] PATH_INFO: `/v3/users` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:51.920669 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1420bde-a50f-4b5b-aed0-a4d246fee5a2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:51.920965 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1420bde-a50f-4b5b-aed0-a4d246fee5a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:51.922426 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1420bde-a50f-4b5b-aed0-a4d246fee5a2 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:51.943153 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 324/647] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Sep 21 11:49:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:51.953271 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e543ff-a7e7-4a37-9b23-bc601b5b2c3e None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:52.033613 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e4df4-ddf5-4ec2-80a2-50cbe4ca14d5 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:52.033939 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e4df4-ddf5-4ec2-80a2-50cbe4ca14d5 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:52.034121 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e4df4-ddf5-4ec2-80a2-50cbe4ca14d5 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:52.035443 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 325/648] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 11:49:52.040771 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5980ff-ca3c-4b15-ae0c-ae1765d3a1b4 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:52.041050 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5980ff-ca3c-4b15-ae0c-ae1765d3a1b4 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:52.041322 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5980ff-ca3c-4b15-ae0c-ae1765d3a1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:52.060372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-5c5980ff-ca3c-4b15-ae0c-ae1765d3a1b4 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:52.061595 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-5c5980ff-ca3c-4b15-ae0c-ae1765d3a1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:52.066953 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:52.070131 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e543ff-a7e7-4a37-9b23-bc601b5b2c3e None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:52.110874 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51459f66-99d5-4243-b0ac-d657ed0ea5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:52.111673 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51459f66-99d5-4243-b0ac-d657ed0ea5d9 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:52.112068 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51459f66-99d5-4243-b0ac-d657ed0ea5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:52.112440 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51459f66-99d5-4243-b0ac-d657ed0ea5d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:52.138808 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:52.153236 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 326/649] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 11:49:52.196021 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51459f66-99d5-4243-b0ac-d657ed0ea5d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:52.197933 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51459f66-99d5-4243-b0ac-d657ed0ea5d9 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:52.313404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:52.317601 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 324/650] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:49:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 11:49:52.323446 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5980ff-ca3c-4b15-ae0c-ae1765d3a1b4 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:52.388588 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62048c-d247-4fd8-aba3-527a90cddc66 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:52.388856 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62048c-d247-4fd8-aba3-527a90cddc66 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:52.389129 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62048c-d247-4fd8-aba3-527a90cddc66 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:52.390726 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 325/651] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 11:49:52.395607 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6360fd-899c-4238-af5f-b12dc6c36d70 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:52.395882 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6360fd-899c-4238-af5f-b12dc6c36d70 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:52.396191 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6360fd-899c-4238-af5f-b12dc6c36d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:52.415176 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-ef6360fd-899c-4238-af5f-b12dc6c36d70 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:52.416412 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-ef6360fd-899c-4238-af5f-b12dc6c36d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:52.426023 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5980ff-ca3c-4b15-ae0c-ae1765d3a1b4 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:52.466600 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9c860-fc76-4cc0-94b3-f9b8b0b58d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:52.467233 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9c860-fc76-4cc0-94b3-f9b8b0b58d7f None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:52.467492 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9c860-fc76-4cc0-94b3-f9b8b0b58d7f None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:52.467820 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9c860-fc76-4cc0-94b3-f9b8b0b58d7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:52.484570 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9c860-fc76-4cc0-94b3-f9b8b0b58d7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:52.486014 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9c860-fc76-4cc0-94b3-f9b8b0b58d7f None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:52.502598 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-84b9c860-fc76-4cc0-94b3-f9b8b0b58d7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:52.502598 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:52.502598 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:52.502598 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:52.502598 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:52.502598 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:52.502598 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:52.502598 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:52.502598 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:52.502598 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:52.502598 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:52.502598 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:52.502598 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:49:52.502598 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:49:52.502598 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:49:52.502598 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:49:52.503625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:52.503625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:52.503625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:52.503625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:52.503625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:52.503625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:52.503625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:52.503625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:52.503625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:52.503625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:52.503625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:52.503625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:52.503625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:52.503625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:52.503625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:52.503625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:52.503625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:49:52.504573 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:49:52.504573 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:52.504573 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:52.508692 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 327/652] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:52.510624 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9c860-fc76-4cc0-94b3-f9b8b0b58d7f None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:52.519148 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 326/653] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 11:49:52.534962 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54368069-5fab-456a-837d-423901732c66 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:52.535948 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54368069-5fab-456a-837d-423901732c66 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:52.536410 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54368069-5fab-456a-837d-423901732c66 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:52.538154 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 327/654] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 11:49:52.539468 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54368069-5fab-456a-837d-423901732c66 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:52.564777 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:52.633479 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9c860-fc76-4cc0-94b3-f9b8b0b58d7f None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:52.646697 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54368069-5fab-456a-837d-423901732c66 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:52.670234 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0239c11-2999-4d0f-8974-59241528f2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:52.670938 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0239c11-2999-4d0f-8974-59241528f2b7 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:52.671220 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0239c11-2999-4d0f-8974-59241528f2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:52.671505 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0239c11-2999-4d0f-8974-59241528f2b7 None admin] PATH_INFO: `/v3/domains` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:52.672178 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0239c11-2999-4d0f-8974-59241528f2b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:52.672448 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0239c11-2999-4d0f-8974-59241528f2b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:52.673945 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0239c11-2999-4d0f-8974-59241528f2b7 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:52.676493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:52.683842 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8daa1ff-6d88-4919-bfe7-0dc614dcbb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:52.684621 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daa1ff-6d88-4919-bfe7-0dc614dcbb52 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:52.684900 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daa1ff-6d88-4919-bfe7-0dc614dcbb52 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:52.685171 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daa1ff-6d88-4919-bfe7-0dc614dcbb52 None admin] PATH_INFO: `/v3/services/image` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:52.685736 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8daa1ff-6d88-4919-bfe7-0dc614dcbb52 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:52.687079 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8daa1ff-6d88-4919-bfe7-0dc614dcbb52 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:52.694920 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 328/655] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:52.694920 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc0c78-4d40-4e44-bc8a-d316c00050e5 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:52.694920 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc0c78-4d40-4e44-bc8a-d316c00050e5 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:52.694920 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc0c78-4d40-4e44-bc8a-d316c00050e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:52.698433 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-b8daa1ff-6d88-4919-bfe7-0dc614dcbb52 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 11:49:52.698433 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:52.698433 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 11:49:52.698433 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 11:49:52.698433 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 11:49:52.698433 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 11:49:52.698433 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 11:49:52.698433 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:49:52.698433 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 11:49:52.698433 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:52.698433 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 11:49:52.698433 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:52.698433 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:52.698433 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:52.698433 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:52.698433 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:52.698433 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:52.699462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:52.699462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:52.699462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:52.699462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:52.699462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:52.699462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:52.699462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 11:49:52.699462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 11:49:52.699462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 11:49:52.699462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 11:49:52.699462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:52.699462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:52.699462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:52.699462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:52.699462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:52.699462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:52.700355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:52.700355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:52.700355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:52.700355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:52.700355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:52.700355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:52.700355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:52.700355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:52.700355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:52.700355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:52.700355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 11:49:52.700355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:49:52.700355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 11:49:52.700355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:52.700355 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 328/656] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Sep 21 11:49:52 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 11:49:52.701182 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8daa1ff-6d88-4919-bfe7-0dc614dcbb52 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:52.714242 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-ccfc0c78-4d40-4e44-bc8a-d316c00050e5 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:52.715437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-ccfc0c78-4d40-4e44-bc8a-d316c00050e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:52.797991 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 329/657] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:49:52.798860 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc0c78-4d40-4e44-bc8a-d316c00050e5 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:52.843290 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:52.843712 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8daa1ff-6d88-4919-bfe7-0dc614dcbb52 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:52.881094 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71be399-ad61-41dd-9019-1b9ae67c2d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:52.881722 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71be399-ad61-41dd-9019-1b9ae67c2d50 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:52.882028 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71be399-ad61-41dd-9019-1b9ae67c2d50 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:52.882526 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71be399-ad61-41dd-9019-1b9ae67c2d50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:52.891062 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71be399-ad61-41dd-9019-1b9ae67c2d50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:52.893084 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71be399-ad61-41dd-9019-1b9ae67c2d50 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:52.908765 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-f71be399-ad61-41dd-9019-1b9ae67c2d50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:49:52.908765 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:52.908765 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:52.908765 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:52.908765 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:52.908765 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:52.908765 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:52.908765 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:52.908765 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:52.908765 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:52.908765 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:52.908765 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:52.908765 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 11:49:52.908765 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 11:49:52.908765 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 11:49:52.909693 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 11:49:52.909693 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:52.909693 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:52.909693 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:52.909693 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:52.909693 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:52.909693 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:52.909693 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:52.909693 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:52.909693 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:52.909693 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:52.909693 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:52.909693 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:52.909693 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:52.909693 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:52.909693 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:52.909693 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:52.910624 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 11:49:52.910624 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 11:49:52.910624 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 11:49:52.910624 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 11:49:52.910624 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 11:49:52.910624 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 11:49:52.910624 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:49:52.910624 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:52.910624 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 329/658] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:49:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:52.910624 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71be399-ad61-41dd-9019-1b9ae67c2d50 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:52.921814 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc0c78-4d40-4e44-bc8a-d316c00050e5 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:52.957167 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1442d4-1a76-45c8-be2f-e2048cd54ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:52.957767 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1442d4-1a76-45c8-be2f-e2048cd54ab6 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:52.958041 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1442d4-1a76-45c8-be2f-e2048cd54ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:52.958306 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1442d4-1a76-45c8-be2f-e2048cd54ab6 None admin] PATH_INFO: `/v3/services` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:52.958924 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1442d4-1a76-45c8-be2f-e2048cd54ab6 None admin] RBAC: Adding query filter params (name=image) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:52.959222 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1442d4-1a76-45c8-be2f-e2048cd54ab6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:52.960615 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1442d4-1a76-45c8-be2f-e2048cd54ab6 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:52.970895 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 330/659] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:52.970895 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1442d4-1a76-45c8-be2f-e2048cd54ab6 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:52.991149 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:53.042951 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71be399-ad61-41dd-9019-1b9ae67c2d50 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:53.077629 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:53.078330 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188e8dd-5fb5-4bb5-ac9c-d9ec89046bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:53.079104 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188e8dd-5fb5-4bb5-ac9c-d9ec89046bda None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:53.079414 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188e8dd-5fb5-4bb5-ac9c-d9ec89046bda None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:53.079666 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188e8dd-5fb5-4bb5-ac9c-d9ec89046bda None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:53.080306 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3188e8dd-5fb5-4bb5-ac9c-d9ec89046bda None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:53.080807 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1442d4-1a76-45c8-be2f-e2048cd54ab6 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:53.081689 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3188e8dd-5fb5-4bb5-ac9c-d9ec89046bda None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:53.092211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-3188e8dd-5fb5-4bb5-ac9c-d9ec89046bda None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 11:49:53.092211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:53.092211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 11:49:53.092211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 11:49:53.092211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 11:49:53.092211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 11:49:53.092211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 11:49:53.092211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:49:53.092211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 11:49:53.092211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:53.092211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 11:49:53.092211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:53.092211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:53.092211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:53.092211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:53.092211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:53.092211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:53.093337 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:53.093337 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:53.093337 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:53.093337 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:53.093337 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:53.093337 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:53.093337 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 11:49:53.093337 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 11:49:53.093337 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 11:49:53.093337 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 11:49:53.093337 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:53.093337 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:53.093337 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:53.093337 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:53.093337 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:53.093337 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:53.094221 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:53.094221 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:53.094221 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:53.094221 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:53.094221 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:53.094221 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:53.094221 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:53.094221 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:53.094221 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:53.094221 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:53.094221 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 11:49:53.094221 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:49:53.094221 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 11:49:53.094221 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:53.094989 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 330/660] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Sep 21 11:49:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:53.095717 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188e8dd-5fb5-4bb5-ac9c-d9ec89046bda None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:53.125319 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584c609-7376-4d17-9bae-c7cd1ba15b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:53.125917 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584c609-7376-4d17-9bae-c7cd1ba15b32 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:53.126345 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584c609-7376-4d17-9bae-c7cd1ba15b32 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:53.126622 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584c609-7376-4d17-9bae-c7cd1ba15b32 None admin] PATH_INFO: `/v3/projects` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:53.127626 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5584c609-7376-4d17-9bae-c7cd1ba15b32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:53.127929 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5584c609-7376-4d17-9bae-c7cd1ba15b32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:53.129454 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5584c609-7376-4d17-9bae-c7cd1ba15b32 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:53.140891 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 331/661] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 11:49:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:53.141529 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584c609-7376-4d17-9bae-c7cd1ba15b32 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:53.199970 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188e8dd-5fb5-4bb5-ac9c-d9ec89046bda None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:53.216730 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:53.234403 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0d500-0bf1-457a-80d8-f0dda138f14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:53.234989 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0d500-0bf1-457a-80d8-f0dda138f14b None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:53.235259 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0d500-0bf1-457a-80d8-f0dda138f14b None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:53.235524 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0d500-0bf1-457a-80d8-f0dda138f14b None admin] PATH_INFO: `/v3/services` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:53.236181 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0d500-0bf1-457a-80d8-f0dda138f14b None admin] RBAC: Adding query filter params (type=image) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:53.236482 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0d500-0bf1-457a-80d8-f0dda138f14b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:53.237829 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0d500-0bf1-457a-80d8-f0dda138f14b None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:53.239586 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584c609-7376-4d17-9bae-c7cd1ba15b32 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:53.243962 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 331/662] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:53 2022] GET /identity/v3/services?type=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:53.244744 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0d500-0bf1-457a-80d8-f0dda138f14b None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:53.277288 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22166716-4309-464b-8bcc-776f857fe5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:53.278027 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22166716-4309-464b-8bcc-776f857fe5a0 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:53.278306 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22166716-4309-464b-8bcc-776f857fe5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:53.278578 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22166716-4309-464b-8bcc-776f857fe5a0 None admin] PATH_INFO: `/v3/services` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:53.279224 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22166716-4309-464b-8bcc-776f857fe5a0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:53.279526 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22166716-4309-464b-8bcc-776f857fe5a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:53.280967 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22166716-4309-464b-8bcc-776f857fe5a0 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:53.291325 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 332/663] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Sep 21 11:49:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:53.291325 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22166716-4309-464b-8bcc-776f857fe5a0 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:53.317761 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:53.377949 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0d500-0bf1-457a-80d8-f0dda138f14b None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:53.403168 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22166716-4309-464b-8bcc-776f857fe5a0 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:53.419318 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505b392-b941-4855-8997-7c87dc3c7de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:53.420096 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505b392-b941-4855-8997-7c87dc3c7de6 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:53.420446 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505b392-b941-4855-8997-7c87dc3c7de6 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:53.420787 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505b392-b941-4855-8997-7c87dc3c7de6 None admin] PATH_INFO: `/v3/services/network` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:53.421458 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505b392-b941-4855-8997-7c87dc3c7de6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:53.422925 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505b392-b941-4855-8997-7c87dc3c7de6 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:53.432496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-e505b392-b941-4855-8997-7c87dc3c7de6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 11:49:53.432496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:53.432496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 11:49:53.432496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 11:49:53.432496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 11:49:53.432496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 11:49:53.432496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 11:49:53.432496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:49:53.432496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 11:49:53.432496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:53.432496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 11:49:53.432496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:53.432496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:53.432496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:53.432496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:53.432496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:53.432496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:53.433774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:53.433774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:53.433774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:53.433774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:53.433774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:53.433774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:53.433774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 11:49:53.433774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 11:49:53.433774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 11:49:53.433774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 11:49:53.433774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:53.433774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:53.433774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:53.433774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:53.433774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:53.433774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:53.434638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:53.434638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:53.434638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:53.434638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:53.434638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:53.434638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:53.434638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:53.434638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:53.434638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:53.434638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:53.434638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 11:49:53.434638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:49:53.434638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 11:49:53.434638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:53.434638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 332/664] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:49:53 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:53.435552 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505b392-b941-4855-8997-7c87dc3c7de6 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:53.451418 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7cf39b-d5eb-4243-9906-9225f0aaaef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:53.452039 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cf39b-d5eb-4243-9906-9225f0aaaef6 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:53.452319 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cf39b-d5eb-4243-9906-9225f0aaaef6 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:53.452580 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cf39b-d5eb-4243-9906-9225f0aaaef6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:53.453308 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7cf39b-d5eb-4243-9906-9225f0aaaef6 None admin] RBAC: Adding query filter params (role.id=d1f3d1431da145709a5e9b374f3b403d, scope.project.id=1fd87b195f7c46d2a0d621124acce331, user.id=c683dcd33e5b40fabbbf12c3dcf97eb1) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:53.453607 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7cf39b-d5eb-4243-9906-9225f0aaaef6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:53.455274 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7cf39b-d5eb-4243-9906-9225f0aaaef6 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:53.462383 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 333/665] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 11:49:53 2022] GET /identity/v3/role_assignments?user.id=c683dcd33e5b40fabbbf12c3dcf97eb1&scope.project.id=1fd87b195f7c46d2a0d621124acce331&role.id=d1f3d1431da145709a5e9b374f3b403d => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:53.462829 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7cf39b-d5eb-4243-9906-9225f0aaaef6 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:53.498776 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:53.573398 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505b392-b941-4855-8997-7c87dc3c7de6 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:53.590359 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:53.612114 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7cf39b-d5eb-4243-9906-9225f0aaaef6 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:53.612841 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6624e-cb59-4e4e-be24-9cee24f622df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:53.613552 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6624e-cb59-4e4e-be24-9cee24f622df None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:53.613920 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6624e-cb59-4e4e-be24-9cee24f622df None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:53.614282 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6624e-cb59-4e4e-be24-9cee24f622df None admin] PATH_INFO: `/v3/services` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:53.615020 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6624e-cb59-4e4e-be24-9cee24f622df None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:53.615439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6624e-cb59-4e4e-be24-9cee24f622df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:53.617058 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6624e-cb59-4e4e-be24-9cee24f622df None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:53.628402 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 333/666] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Sep 21 11:49:53 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:53.658249 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9118244-4571-41f9-a3e3-01c8f5802988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:53.659250 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9118244-4571-41f9-a3e3-01c8f5802988 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:53.659693 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9118244-4571-41f9-a3e3-01c8f5802988 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:53.660141 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9118244-4571-41f9-a3e3-01c8f5802988 None admin] PATH_INFO: `/v3/services` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:53.660958 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9118244-4571-41f9-a3e3-01c8f5802988 None admin] RBAC: Adding query filter params (name=network) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:53.661418 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9118244-4571-41f9-a3e3-01c8f5802988 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:53.663049 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9118244-4571-41f9-a3e3-01c8f5802988 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:53.669668 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 334/667] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 21 11:49:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:53.675326 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6624e-cb59-4e4e-be24-9cee24f622df None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:53.798580 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6624e-cb59-4e4e-be24-9cee24f622df None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:53.815170 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:53.842429 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce666b-3f94-4e8e-8d7a-e94a03a443fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:53.843026 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce666b-3f94-4e8e-8d7a-e94a03a443fa None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:53.843297 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce666b-3f94-4e8e-8d7a-e94a03a443fa None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:53.843562 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce666b-3f94-4e8e-8d7a-e94a03a443fa None admin] PATH_INFO: `/v3/services` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:53.844214 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce666b-3f94-4e8e-8d7a-e94a03a443fa None admin] RBAC: Adding query filter params (type=network) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:53.844509 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce666b-3f94-4e8e-8d7a-e94a03a443fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:53.845866 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce666b-3f94-4e8e-8d7a-e94a03a443fa None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:53.851164 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 334/668] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 21 11:49:53 2022] GET /identity/v3/services?type=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:55.734984 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8051c4-badb-4f62-af4c-c1972cf83ec5 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:55.736057 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8051c4-badb-4f62-af4c-c1972cf83ec5 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:55.736620 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8051c4-badb-4f62-af4c-c1972cf83ec5 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:55.738484 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 335/669] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 11:49:55.744362 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd053f7-b4c3-44f1-9d78-4eb049be0d62 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:55.745251 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd053f7-b4c3-44f1-9d78-4eb049be0d62 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:55.745725 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd053f7-b4c3-44f1-9d78-4eb049be0d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:55.765112 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-bcd053f7-b4c3-44f1-9d78-4eb049be0d62 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:55.766745 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-bcd053f7-b4c3-44f1-9d78-4eb049be0d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:55.840248 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 335/670] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:49:55.955498 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be1d2f-3a92-4324-860d-23c8809cc829 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:55.956158 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be1d2f-3a92-4324-860d-23c8809cc829 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:55.956661 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be1d2f-3a92-4324-860d-23c8809cc829 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:55.958426 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 336/671] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:55.966020 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9afc73c-da17-4dec-bb93-1192b434e42c None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:55.966595 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9afc73c-da17-4dec-bb93-1192b434e42c None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:55.967069 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9afc73c-da17-4dec-bb93-1192b434e42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:55.985802 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-c9afc73c-da17-4dec-bb93-1192b434e42c None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:55.987287 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-c9afc73c-da17-4dec-bb93-1192b434e42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:56.063965 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 336/672] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:49:56.077767 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ac90c-3f81-4384-af62-7a2aee84f358 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:56.078045 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ac90c-3f81-4384-af62-7a2aee84f358 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:56.078311 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ac90c-3f81-4384-af62-7a2aee84f358 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:56.079629 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 337/673] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:56.084852 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbd6fc-f690-487a-8223-b6ecdb60cb4d None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:56.085136 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbd6fc-f690-487a-8223-b6ecdb60cb4d None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:56.085408 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbd6fc-f690-487a-8223-b6ecdb60cb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:56.104068 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-0ddbd6fc-f690-487a-8223-b6ecdb60cb4d None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:56.105173 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-0ddbd6fc-f690-487a-8223-b6ecdb60cb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:56.133300 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:56.176306 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ac90c-3f81-4384-af62-7a2aee84f358 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:56.178256 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 337/674] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:49:56.287439 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ac90c-3f81-4384-af62-7a2aee84f358 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:56.318596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780e751-e3da-429e-b59b-3cee9e65a16a None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:56.318940 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780e751-e3da-429e-b59b-3cee9e65a16a None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:56.319144 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780e751-e3da-429e-b59b-3cee9e65a16a None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:56.321697 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 338/675] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 11:49:56.329329 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45a200-4e57-4cf2-8145-920e87dcaba1 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:56.329642 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e32b8e-0882-4e99-ba2c-721d6ff5a525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:56.329788 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45a200-4e57-4cf2-8145-920e87dcaba1 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:56.329935 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45a200-4e57-4cf2-8145-920e87dcaba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:56.330698 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e32b8e-0882-4e99-ba2c-721d6ff5a525 None admin] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:56.331155 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e32b8e-0882-4e99-ba2c-721d6ff5a525 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:56.331599 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e32b8e-0882-4e99-ba2c-721d6ff5a525 None admin] PATH_INFO: `/v3/services` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:56.332479 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e32b8e-0882-4e99-ba2c-721d6ff5a525 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:56.334021 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e32b8e-0882-4e99-ba2c-721d6ff5a525 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:56.351774 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 338/676] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 21 11:49:56 2022] POST /identity/v3/services => generated 242 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 11:49:56.359634 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-8c45a200-4e57-4cf2-8145-920e87dcaba1 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:56.361401 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-8c45a200-4e57-4cf2-8145-920e87dcaba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:56.439005 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e32b8e-0882-4e99-ba2c-721d6ff5a525 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:56.451558 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 339/677] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:56 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 11:49:56.459509 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:56.529042 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45a200-4e57-4cf2-8145-920e87dcaba1 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:56.560956 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e32b8e-0882-4e99-ba2c-721d6ff5a525 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:56.596982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe8e30-2d05-4204-84b6-ccf877ad9b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:56.597613 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe8e30-2d05-4204-84b6-ccf877ad9b70 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:56.597953 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe8e30-2d05-4204-84b6-ccf877ad9b70 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:56.598224 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe8e30-2d05-4204-84b6-ccf877ad9b70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:56.613221 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe8e30-2d05-4204-84b6-ccf877ad9b70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:49:56.618929 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-ecbe8e30-2d05-4204-84b6-ccf877ad9b70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:49:56.618929 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:56.618929 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:56.618929 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:56.618929 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:56.618929 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:56.618929 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:56.618929 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:56.618929 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:56.618929 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:56.618929 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:56.618929 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:56.618929 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:49:56.618929 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:49:56.618929 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:49:56.618929 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:49:56.619863 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:49:56.619863 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:49:56.619863 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:49:56.619863 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:49:56.619863 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:56.619863 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:56.619863 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:56.619863 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:56.619863 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:56.619863 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:56.619863 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:56.619863 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:56.619863 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:56.619863 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:56.619863 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:56.619863 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:56.620771 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:56.620771 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:56.620771 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:56.620771 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:56.620771 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:49:56.620771 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:49:56.620771 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:49:56.620771 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:49:56.620771 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:49:56.620771 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:49:56.620771 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:49:56.620771 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:56.620771 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 339/678] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 11:49:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 11:49:56.626152 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe8e30-2d05-4204-84b6-ccf877ad9b70 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:56.640217 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:56.652910 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45a200-4e57-4cf2-8145-920e87dcaba1 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:56.692113 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0453316-1019-4e1d-baa6-675ec1a3dc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:56.692828 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0453316-1019-4e1d-baa6-675ec1a3dc5d None admin] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:56.693097 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0453316-1019-4e1d-baa6-675ec1a3dc5d None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:56.693360 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0453316-1019-4e1d-baa6-675ec1a3dc5d None admin] PATH_INFO: `/v3/services` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:56.694022 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0453316-1019-4e1d-baa6-675ec1a3dc5d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:56.695508 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0453316-1019-4e1d-baa6-675ec1a3dc5d None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:56.704677 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:56.713767 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 340/679] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 21 11:49:56 2022] POST /identity/v3/services => generated 251 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 11:49:56.750723 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe8e30-2d05-4204-84b6-ccf877ad9b70 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:56.791030 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0453316-1019-4e1d-baa6-675ec1a3dc5d None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:56.812796 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9f95b-d88b-44cd-95ca-f5974b0962ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:56.813415 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9f95b-d88b-44cd-95ca-f5974b0962ec None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:56.813691 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9f95b-d88b-44cd-95ca-f5974b0962ec None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:56.813965 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9f95b-d88b-44cd-95ca-f5974b0962ec None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:56.814657 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa9f95b-d88b-44cd-95ca-f5974b0962ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:56.814962 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa9f95b-d88b-44cd-95ca-f5974b0962ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:56.816434 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa9f95b-d88b-44cd-95ca-f5974b0962ec None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:56.825823 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 340/680] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:49:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:49:56.833401 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9f95b-d88b-44cd-95ca-f5974b0962ec None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:56.912701 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0453316-1019-4e1d-baa6-675ec1a3dc5d None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:56.950217 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9f95b-d88b-44cd-95ca-f5974b0962ec None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:56.951075 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348033db-6880-4d5f-939b-861d21cb2585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:56.951885 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348033db-6880-4d5f-939b-861d21cb2585 None admin] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:56.952194 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348033db-6880-4d5f-939b-861d21cb2585 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:56.952462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348033db-6880-4d5f-939b-861d21cb2585 None admin] PATH_INFO: `/v3/services` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:56.953613 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348033db-6880-4d5f-939b-861d21cb2585 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:56.954479 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348033db-6880-4d5f-939b-861d21cb2585 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:56.973181 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 341/681] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 21 11:49:56 2022] POST /identity/v3/services => generated 240 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 11:49:56.984802 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:56.998187 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4bbc5-07f3-4110-8706-3620cc25dc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:56.998841 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4bbc5-07f3-4110-8706-3620cc25dc1a None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:56.999119 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4bbc5-07f3-4110-8706-3620cc25dc1a None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:56.999387 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4bbc5-07f3-4110-8706-3620cc25dc1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:57.013767 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4bbc5-07f3-4110-8706-3620cc25dc1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:57.015327 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4bbc5-07f3-4110-8706-3620cc25dc1a None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:57.031577 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-45e4bbc5-07f3-4110-8706-3620cc25dc1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:57.031577 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:57.031577 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:57.031577 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:57.031577 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:57.031577 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:57.031577 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:57.031577 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:57.031577 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:57.031577 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:57.031577 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:57.031577 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:57.031577 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:49:57.031577 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:49:57.031577 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:49:57.031577 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:49:57.032625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:57.032625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:57.032625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:57.032625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:57.032625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:57.032625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:57.032625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:57.032625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:57.032625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:57.032625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:57.032625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:57.032625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:57.032625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:57.032625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:57.032625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:57.032625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:57.032625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:49:57.034223 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:49:57.034223 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:57.034223 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:57.034223 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 341/682] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 11:49:57.039751 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348033db-6880-4d5f-939b-861d21cb2585 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:57.054614 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:57.157391 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348033db-6880-4d5f-939b-861d21cb2585 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:57.196310 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2a425-0c4d-4623-b235-503519cbbe44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:57.197159 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2a425-0c4d-4623-b235-503519cbbe44 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:57.197597 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2a425-0c4d-4623-b235-503519cbbe44 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:57.198007 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2a425-0c4d-4623-b235-503519cbbe44 None admin] PATH_INFO: `/v3/domains` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:57.198812 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2a425-0c4d-4623-b235-503519cbbe44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:57.199256 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2a425-0c4d-4623-b235-503519cbbe44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:57.200796 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2a425-0c4d-4623-b235-503519cbbe44 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:57.215646 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 342/683] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:57.220988 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4bbc5-07f3-4110-8706-3620cc25dc1a None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:57.330480 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4bbc5-07f3-4110-8706-3620cc25dc1a None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:57.365604 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936dd72c-5b7c-4320-8e92-f54109314a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:57.366233 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936dd72c-5b7c-4320-8e92-f54109314a45 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:57.366509 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936dd72c-5b7c-4320-8e92-f54109314a45 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:57.366809 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936dd72c-5b7c-4320-8e92-f54109314a45 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:57.374635 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936dd72c-5b7c-4320-8e92-f54109314a45 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:57.376101 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936dd72c-5b7c-4320-8e92-f54109314a45 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:57.387834 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-936dd72c-5b7c-4320-8e92-f54109314a45 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 11:49:57.387834 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:57.387834 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:57.387834 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:57.387834 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:57.387834 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:57.387834 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:57.387834 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:57.387834 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:57.387834 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:57.387834 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:57.387834 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:57.387834 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 11:49:57.387834 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 11:49:57.387834 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 11:49:57.387834 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 11:49:57.388858 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:57.388858 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:57.388858 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 11:49:57.388858 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:49:57.388858 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 11:49:57.388858 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:49:57.388858 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:57.388858 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:57.388858 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:57.388858 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:57.388858 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:57.388858 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:57.388858 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:57.388858 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:57.388858 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:57.388858 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:57.388858 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:57.388858 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:57.389820 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:57.389820 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:57.389820 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 11:49:57.389820 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 11:49:57.389820 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 11:49:57.389820 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 11:49:57.389820 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 11:49:57.389820 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 11:49:57.389820 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 11:49:57.389820 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:57.389820 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 342/684] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Sep 21 11:49:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:57.396843 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2a425-0c4d-4623-b235-503519cbbe44 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:57.469944 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:57.508620 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2a425-0c4d-4623-b235-503519cbbe44 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:57.545203 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566ba85-bb5f-42df-8986-953f0ced6e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:57.545803 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566ba85-bb5f-42df-8986-953f0ced6e19 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:57.546113 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566ba85-bb5f-42df-8986-953f0ced6e19 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:57.546379 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566ba85-bb5f-42df-8986-953f0ced6e19 None admin] PATH_INFO: `/v3/users` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:57.547104 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566ba85-bb5f-42df-8986-953f0ced6e19 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:57.547401 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566ba85-bb5f-42df-8986-953f0ced6e19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:57.548898 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566ba85-bb5f-42df-8986-953f0ced6e19 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:57.567965 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 343/685] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Sep 21 11:49:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:57.573976 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936dd72c-5b7c-4320-8e92-f54109314a45 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:57.628513 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:57.696684 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936dd72c-5b7c-4320-8e92-f54109314a45 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:57.730655 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb00bf4-e3db-40a1-a9a6-a2cdcff18550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:57.731200 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb00bf4-e3db-40a1-a9a6-a2cdcff18550 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:57.731473 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb00bf4-e3db-40a1-a9a6-a2cdcff18550 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:57.731740 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb00bf4-e3db-40a1-a9a6-a2cdcff18550 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:57.742996 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb00bf4-e3db-40a1-a9a6-a2cdcff18550 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:57.744468 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb00bf4-e3db-40a1-a9a6-a2cdcff18550 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:57.759386 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-ebb00bf4-e3db-40a1-a9a6-a2cdcff18550 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:57.759386 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:57.759386 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:57.759386 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:57.759386 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:57.759386 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:57.759386 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:57.759386 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:57.759386 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:57.759386 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:57.759386 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:57.759386 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:57.759386 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:49:57.759386 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:49:57.759386 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:49:57.759386 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:49:57.760841 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:57.760841 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:57.760841 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:57.760841 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:57.760841 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:57.760841 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:57.760841 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:57.760841 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:57.760841 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:57.760841 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:57.760841 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:57.760841 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:57.760841 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:57.760841 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:57.760841 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:57.760841 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:57.760841 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:49:57.761776 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:49:57.761776 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:49:57.761776 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:57.761776 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 343/686] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:57.768076 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566ba85-bb5f-42df-8986-953f0ced6e19 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:57.877856 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566ba85-bb5f-42df-8986-953f0ced6e19 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:57.906586 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:57.915793 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1280d2-f6c2-4b4f-88ee-ecbe0d30dfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:57.916561 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1280d2-f6c2-4b4f-88ee-ecbe0d30dfab None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:57.916888 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1280d2-f6c2-4b4f-88ee-ecbe0d30dfab None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:57.917346 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1280d2-f6c2-4b4f-88ee-ecbe0d30dfab None admin] PATH_INFO: `/v3/domains` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:57.917981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1280d2-f6c2-4b4f-88ee-ecbe0d30dfab None admin] RBAC: Adding query filter params (name=Default) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:57.918277 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1280d2-f6c2-4b4f-88ee-ecbe0d30dfab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:57.919624 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1280d2-f6c2-4b4f-88ee-ecbe0d30dfab None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:57.931830 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 344/687] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:57.941182 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb00bf4-e3db-40a1-a9a6-a2cdcff18550 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:58.034109 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:58.044814 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb00bf4-e3db-40a1-a9a6-a2cdcff18550 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:58.081294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ed8d8-2280-4e83-b9d9-c0323d49637f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:58.081921 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ed8d8-2280-4e83-b9d9-c0323d49637f None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:58.082198 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ed8d8-2280-4e83-b9d9-c0323d49637f None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:58.082470 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ed8d8-2280-4e83-b9d9-c0323d49637f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:58.089785 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ed8d8-2280-4e83-b9d9-c0323d49637f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:58.091235 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ed8d8-2280-4e83-b9d9-c0323d49637f None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:58.102496 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-b65ed8d8-2280-4e83-b9d9-c0323d49637f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:49:58.102496 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:58.102496 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:58.102496 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:58.102496 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:58.102496 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:58.102496 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:58.102496 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:58.102496 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:58.102496 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:58.102496 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:58.102496 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:58.102496 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 11:49:58.102496 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 11:49:58.102496 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 11:49:58.103437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 11:49:58.103437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:58.103437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:58.103437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:58.103437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:58.103437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:58.103437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:58.103437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:58.103437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:58.103437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:58.103437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:58.103437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:58.103437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:58.103437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:58.103437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:58.103437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:58.103437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:58.104423 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 11:49:58.104423 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 11:49:58.104423 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 11:49:58.104423 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 11:49:58.104423 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 11:49:58.104423 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 11:49:58.104423 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:49:58.104423 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:49:58.104423 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 344/688] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:49:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:58.111134 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1280d2-f6c2-4b4f-88ee-ecbe0d30dfab None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:58.217555 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1280d2-f6c2-4b4f-88ee-ecbe0d30dfab None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:58.256268 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde146c-ffa7-4c82-afba-81b9a8ffba4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:58.256868 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde146c-ffa7-4c82-afba-81b9a8ffba4d None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:58.257157 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde146c-ffa7-4c82-afba-81b9a8ffba4d None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:58.258027 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde146c-ffa7-4c82-afba-81b9a8ffba4d None admin] PATH_INFO: `/v3/projects` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:58.258640 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde146c-ffa7-4c82-afba-81b9a8ffba4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:58.258936 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde146c-ffa7-4c82-afba-81b9a8ffba4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:58.260404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde146c-ffa7-4c82-afba-81b9a8ffba4d None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:58.273986 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 345/689] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 11:49:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:58.279798 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ed8d8-2280-4e83-b9d9-c0323d49637f None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:58.387201 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ed8d8-2280-4e83-b9d9-c0323d49637f None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:58.421839 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3fef1-bd4b-4d4c-a129-52f2943da201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:58.422501 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3fef1-bd4b-4d4c-a129-52f2943da201 None admin] REQUEST_METHOD: `PUT` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:58.422787 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3fef1-bd4b-4d4c-a129-52f2943da201 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:58.423050 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3fef1-bd4b-4d4c-a129-52f2943da201 None admin] PATH_INFO: `/v3/projects/1fd87b195f7c46d2a0d621124acce331/users/c683dcd33e5b40fabbbf12c3dcf97eb1/roles/d1f3d1431da145709a5e9b374f3b403d` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:58.425066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3fef1-bd4b-4d4c-a129-52f2943da201 None admin] RBAC: Authorizing `identity:create_grant(project_id=1fd87b195f7c46d2a0d621124acce331, user_id=c683dcd33e5b40fabbbf12c3dcf97eb1, role_id=d1f3d1431da145709a5e9b374f3b403d)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:58.426512 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3fef1-bd4b-4d4c-a129-52f2943da201 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:58.440909 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 345/690] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 11:49:58 2022] PUT /identity/v3/projects/1fd87b195f7c46d2a0d621124acce331/users/c683dcd33e5b40fabbbf12c3dcf97eb1/roles/d1f3d1431da145709a5e9b374f3b403d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 11:49:58.970862 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f76f8-1546-4bde-8a61-467137b4f372 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:58.971391 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f76f8-1546-4bde-8a61-467137b4f372 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:58.971391 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f76f8-1546-4bde-8a61-467137b4f372 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:58.973029 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 346/691] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:58.978791 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f534fe-b13b-4316-b2a5-546a4bd1b9f9 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:58.979206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f534fe-b13b-4316-b2a5-546a4bd1b9f9 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:58.979373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f534fe-b13b-4316-b2a5-546a4bd1b9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:58.998727 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-b8f534fe-b13b-4316-b2a5-546a4bd1b9f9 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:58.999959 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-b8f534fe-b13b-4316-b2a5-546a4bd1b9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:59.003793 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:59.074358 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 346/692] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:58 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 11:49:59.390121 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c9384-8bd4-4fa0-a684-dac7a3efc10d None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:59.390788 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c9384-8bd4-4fa0-a684-dac7a3efc10d None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:59.391358 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c9384-8bd4-4fa0-a684-dac7a3efc10d None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:59.393229 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 347/693] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:49:59.399686 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96275322-34cc-4376-b0cd-8fd7e0477598 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:59.400254 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96275322-34cc-4376-b0cd-8fd7e0477598 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:59.400728 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96275322-34cc-4376-b0cd-8fd7e0477598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:59.404253 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c9384-8bd4-4fa0-a684-dac7a3efc10d None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:59.420403 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-96275322-34cc-4376-b0cd-8fd7e0477598 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:59.421571 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-96275322-34cc-4376-b0cd-8fd7e0477598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:59.463524 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:59.496783 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 347/694] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:59 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 11:49:59.524682 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c9384-8bd4-4fa0-a684-dac7a3efc10d None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:59.560041 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e779b-8e01-47d1-b1db-3862e0a07bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:59.560892 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e779b-8e01-47d1-b1db-3862e0a07bcb None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:59.561314 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e779b-8e01-47d1-b1db-3862e0a07bcb None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:59.561725 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e779b-8e01-47d1-b1db-3862e0a07bcb None admin] PATH_INFO: `/v3/services/image` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:59.562438 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e779b-8e01-47d1-b1db-3862e0a07bcb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:59.564059 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e779b-8e01-47d1-b1db-3862e0a07bcb None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:59.573811 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-f84e779b-8e01-47d1-b1db-3862e0a07bcb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 11:49:59.573811 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:59.573811 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 11:49:59.573811 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 11:49:59.573811 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 11:49:59.573811 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 11:49:59.573811 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 11:49:59.573811 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:49:59.573811 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 11:49:59.573811 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:59.573811 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 11:49:59.573811 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:59.573811 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:49:59.573811 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:49:59.573811 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:49:59.573811 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:49:59.573811 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:49:59.575016 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:49:59.575016 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:49:59.575016 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:49:59.575016 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:49:59.575016 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:49:59.575016 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:49:59.575016 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 11:49:59.575016 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 11:49:59.575016 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 11:49:59.575016 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 11:49:59.575016 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:49:59.575016 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:49:59.575016 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:49:59.575016 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:49:59.575016 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:49:59.575016 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:49:59.576099 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:49:59.576099 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:49:59.576099 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:49:59.576099 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:49:59.576099 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:49:59.576099 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:49:59.576099 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:49:59.576099 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:49:59.576099 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:49:59.576099 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:49:59.576099 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 11:49:59.576099 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:49:59.576099 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 11:49:59.576099 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:49:59.578860 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 348/695] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Sep 21 11:49:59 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:49:59.584829 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96275322-34cc-4376-b0cd-8fd7e0477598 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:59.604760 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8749c-d2e1-4c18-8085-4f32fe2511b5 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:59.605205 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8749c-d2e1-4c18-8085-4f32fe2511b5 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:59.605572 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8749c-d2e1-4c18-8085-4f32fe2511b5 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:59.611366 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 349/696] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:49:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 11:49:59.613234 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780966d3-523e-428b-b9bd-85dcaff9ec91 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:59.613621 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780966d3-523e-428b-b9bd-85dcaff9ec91 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:59.613988 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780966d3-523e-428b-b9bd-85dcaff9ec91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:59.632969 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-780966d3-523e-428b-b9bd-85dcaff9ec91 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:49:59.634316 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-780966d3-523e-428b-b9bd-85dcaff9ec91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:49:59.673628 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:59.715160 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96275322-34cc-4376-b0cd-8fd7e0477598 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:59.720157 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 350/697] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:49:59 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 11:49:59.753979 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2a3c1-873b-42d1-8009-54fc03a0d920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:59.755195 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2a3c1-873b-42d1-8009-54fc03a0d920 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:59.755674 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2a3c1-873b-42d1-8009-54fc03a0d920 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:59.756196 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2a3c1-873b-42d1-8009-54fc03a0d920 None admin] PATH_INFO: `/v3/services` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:59.757621 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2a3c1-873b-42d1-8009-54fc03a0d920 None admin] RBAC: Adding query filter params (name=image) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:59.758160 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2a3c1-873b-42d1-8009-54fc03a0d920 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:59.759702 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2a3c1-873b-42d1-8009-54fc03a0d920 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:59.765104 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 348/698] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:59.770873 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780966d3-523e-428b-b9bd-85dcaff9ec91 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:59.817721 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:49:59.831332 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2a3c1-873b-42d1-8009-54fc03a0d920 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:59.880279 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780966d3-523e-428b-b9bd-85dcaff9ec91 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:59.918655 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066136dc-3566-4ed1-8b41-828c3a713981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:59.919282 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066136dc-3566-4ed1-8b41-828c3a713981 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:59.919556 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066136dc-3566-4ed1-8b41-828c3a713981 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:59.919823 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066136dc-3566-4ed1-8b41-828c3a713981 None admin] PATH_INFO: `/v3/services` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:59.920480 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066136dc-3566-4ed1-8b41-828c3a713981 None admin] RBAC: Adding query filter params (type=image) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:49:59.920777 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066136dc-3566-4ed1-8b41-828c3a713981 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:59.922141 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066136dc-3566-4ed1-8b41-828c3a713981 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:59.932565 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 351/699] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:49:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:49:59.933517 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066136dc-3566-4ed1-8b41-828c3a713981 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:49:59.948672 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2a3c1-873b-42d1-8009-54fc03a0d920 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:49:59.986752 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ea1ab-7f79-43b7-bb88-5f8761f43db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:49:59.987408 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ea1ab-7f79-43b7-bb88-5f8761f43db6 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:49:59.987649 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ea1ab-7f79-43b7-bb88-5f8761f43db6 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:49:59.988730 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ea1ab-7f79-43b7-bb88-5f8761f43db6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:49:59.988730 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ea1ab-7f79-43b7-bb88-5f8761f43db6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:49:59.989953 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ea1ab-7f79-43b7-bb88-5f8761f43db6 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:49:59.992506 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:00.004101 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-0f5ea1ab-7f79-43b7-bb88-5f8761f43db6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 11:50:00.004101 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:00.004101 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 11:50:00.004101 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 11:50:00.004101 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 11:50:00.004101 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 11:50:00.004101 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 11:50:00.004101 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:50:00.004101 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 11:50:00.004101 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:50:00.004101 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 11:50:00.004101 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:50:00.004101 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:00.004101 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:50:00.004101 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:50:00.004101 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:50:00.004101 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:50:00.005350 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:50:00.005350 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:50:00.005350 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:50:00.005350 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:50:00.005350 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:50:00.005350 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:50:00.005350 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 11:50:00.005350 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 11:50:00.005350 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 11:50:00.005350 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 11:50:00.005350 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:50:00.005350 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:50:00.005350 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:50:00.005350 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:50:00.005350 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:50:00.005350 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:50:00.006252 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:50:00.006252 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:50:00.006252 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:50:00.006252 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:50:00.006252 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:50:00.006252 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:50:00.006252 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:50:00.006252 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:50:00.006252 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:50:00.006252 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:50:00.006252 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 11:50:00.006252 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:50:00.006252 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 11:50:00.006252 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:50:00.009238 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 349/700] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Sep 21 11:49:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 11:50:00.020020 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ea1ab-7f79-43b7-bb88-5f8761f43db6 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:00.038968 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066136dc-3566-4ed1-8b41-828c3a713981 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:00.050192 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:00.087515 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73826814-20b0-4a20-90bd-90e14b836c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:00.088637 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73826814-20b0-4a20-90bd-90e14b836c7f None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:00.089096 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73826814-20b0-4a20-90bd-90e14b836c7f None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:00.089814 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73826814-20b0-4a20-90bd-90e14b836c7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:00.090924 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73826814-20b0-4a20-90bd-90e14b836c7f None admin] RBAC: Adding query filter params (interface=public, service_id=611f358364084c22bf72bac53135d66f, region_id=RegionOne) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:00.091420 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73826814-20b0-4a20-90bd-90e14b836c7f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:00.093151 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73826814-20b0-4a20-90bd-90e14b836c7f None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:00.103233 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 352/701] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Sep 21 11:49:59 2022] GET /identity/v3/endpoints?service_id=611f358364084c22bf72bac53135d66f&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:50:00.108382 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73826814-20b0-4a20-90bd-90e14b836c7f None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:00.133304 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ea1ab-7f79-43b7-bb88-5f8761f43db6 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:00.168872 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c63c9-0d4f-4b9f-a1bf-b2c88cf87ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:00.169463 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c63c9-0d4f-4b9f-a1bf-b2c88cf87ac0 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:00.169744 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c63c9-0d4f-4b9f-a1bf-b2c88cf87ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:00.170014 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c63c9-0d4f-4b9f-a1bf-b2c88cf87ac0 None admin] PATH_INFO: `/v3/services` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:00.170625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c63c9-0d4f-4b9f-a1bf-b2c88cf87ac0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:00.170921 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c63c9-0d4f-4b9f-a1bf-b2c88cf87ac0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:00.172314 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c63c9-0d4f-4b9f-a1bf-b2c88cf87ac0 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:00.177163 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 350/702] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Sep 21 11:50:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:50:00.177894 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c63c9-0d4f-4b9f-a1bf-b2c88cf87ac0 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:00.216995 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73826814-20b0-4a20-90bd-90e14b836c7f None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:00.241764 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:00.253456 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d781c7-26a3-4a10-bb94-5d1df7e23619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:00.253792 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d781c7-26a3-4a10-bb94-5d1df7e23619 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:00.254061 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d781c7-26a3-4a10-bb94-5d1df7e23619 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:00.254322 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d781c7-26a3-4a10-bb94-5d1df7e23619 None admin] PATH_INFO: `/v3/services/network` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:00.254887 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d781c7-26a3-4a10-bb94-5d1df7e23619 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:00.256268 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d781c7-26a3-4a10-bb94-5d1df7e23619 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:00.266333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-08d781c7-26a3-4a10-bb94-5d1df7e23619 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 11:50:00.266333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:00.266333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 11:50:00.266333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 11:50:00.266333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 11:50:00.266333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 11:50:00.266333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 11:50:00.266333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:50:00.266333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 11:50:00.266333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:50:00.266333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 11:50:00.266333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:50:00.266333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:00.266333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:50:00.266333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:50:00.266333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:50:00.266333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:50:00.267359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:50:00.267359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:50:00.267359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:50:00.267359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:50:00.267359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:50:00.267359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:50:00.267359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 11:50:00.267359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 11:50:00.267359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 11:50:00.267359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 11:50:00.267359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:50:00.267359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:50:00.267359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:50:00.267359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:50:00.267359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:50:00.267359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:50:00.268250 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:50:00.268250 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:50:00.268250 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:50:00.268250 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:50:00.268250 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:50:00.268250 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:50:00.268250 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:50:00.268250 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:50:00.268250 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:50:00.268250 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:50:00.268250 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 11:50:00.268250 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:50:00.268250 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 11:50:00.268250 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:50:00.268250 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 353/703] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:50:00 2022] GET /identity/v3/services/network => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:50:00.269149 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d781c7-26a3-4a10-bb94-5d1df7e23619 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:00.292551 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c63c9-0d4f-4b9f-a1bf-b2c88cf87ac0 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:00.305123 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:00.328025 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c968f20-5f74-4087-b2ac-cfd56a088816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:00.328641 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c968f20-5f74-4087-b2ac-cfd56a088816 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:00.328919 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c968f20-5f74-4087-b2ac-cfd56a088816 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:00.329190 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c968f20-5f74-4087-b2ac-cfd56a088816 None admin] PATH_INFO: `/v3/services` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:00.329788 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c968f20-5f74-4087-b2ac-cfd56a088816 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:00.331155 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c968f20-5f74-4087-b2ac-cfd56a088816 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:00.348037 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 351/704] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 21 11:50:00 2022] GET /identity/v3/services => generated 1002 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 11:50:00.348037 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c968f20-5f74-4087-b2ac-cfd56a088816 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:00.402859 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d781c7-26a3-4a10-bb94-5d1df7e23619 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:00.452017 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c968f20-5f74-4087-b2ac-cfd56a088816 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:00.452231 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed09486-abdb-4005-86fb-bcfb9c7a71b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:00.452680 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed09486-abdb-4005-86fb-bcfb9c7a71b0 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:00.452959 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed09486-abdb-4005-86fb-bcfb9c7a71b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:00.453227 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed09486-abdb-4005-86fb-bcfb9c7a71b0 None admin] PATH_INFO: `/v3/services` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:00.453865 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed09486-abdb-4005-86fb-bcfb9c7a71b0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:00.454481 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed09486-abdb-4005-86fb-bcfb9c7a71b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:00.456933 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed09486-abdb-4005-86fb-bcfb9c7a71b0 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:00.464176 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 354/705] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Sep 21 11:50:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:50:00.469243 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed09486-abdb-4005-86fb-bcfb9c7a71b0 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:00.493727 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:00.504154 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5b35f-a110-4d67-9bcb-4a8ae4a2148c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:00.504831 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5b35f-a110-4d67-9bcb-4a8ae4a2148c None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:00.505107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5b35f-a110-4d67-9bcb-4a8ae4a2148c None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:00.505373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5b35f-a110-4d67-9bcb-4a8ae4a2148c None admin] PATH_INFO: `/v3/services` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:00.506003 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a5b35f-a110-4d67-9bcb-4a8ae4a2148c None admin] RBAC: Adding query filter params (name=network) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:00.506297 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a5b35f-a110-4d67-9bcb-4a8ae4a2148c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:00.508270 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a5b35f-a110-4d67-9bcb-4a8ae4a2148c None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:00.517924 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 352/706] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 21 11:50:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:50:00.519477 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5b35f-a110-4d67-9bcb-4a8ae4a2148c None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:00.635603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:00.640766 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed09486-abdb-4005-86fb-bcfb9c7a71b0 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:00.642047 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5b35f-a110-4d67-9bcb-4a8ae4a2148c None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:00.685039 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea8f63-fcfc-4c54-8cc6-268b3c4ee5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:00.685624 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea8f63-fcfc-4c54-8cc6-268b3c4ee5ca None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:00.685897 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea8f63-fcfc-4c54-8cc6-268b3c4ee5ca None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:00.686164 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea8f63-fcfc-4c54-8cc6-268b3c4ee5ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:00.686852 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea8f63-fcfc-4c54-8cc6-268b3c4ee5ca None admin] RBAC: Adding query filter params (interface=public, service_id=2161f8499ddd47a991f0a5d75bb93e2e, region_id=RegionOne) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:00.687154 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea8f63-fcfc-4c54-8cc6-268b3c4ee5ca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:00.687669 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1992e-fb5a-4f4e-a869-7e6b4e51c00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:00.688368 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1992e-fb5a-4f4e-a869-7e6b4e51c00a None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:00.688569 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea8f63-fcfc-4c54-8cc6-268b3c4ee5ca None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:00.688705 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1992e-fb5a-4f4e-a869-7e6b4e51c00a None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:00.688899 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1992e-fb5a-4f4e-a869-7e6b4e51c00a None admin] PATH_INFO: `/v3/services` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:00.689525 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1992e-fb5a-4f4e-a869-7e6b4e51c00a None admin] RBAC: Adding query filter params (type=network) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:00.689855 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1992e-fb5a-4f4e-a869-7e6b4e51c00a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:00.691398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1992e-fb5a-4f4e-a869-7e6b4e51c00a None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:00.694899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 355/707] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Sep 21 11:50:00 2022] GET /identity/v3/endpoints?service_id=2161f8499ddd47a991f0a5d75bb93e2e&interface=public®ion_id=RegionOne => generated 194 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:50:00.697715 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 353/708] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 21 11:50:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:50:00.703433 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea8f63-fcfc-4c54-8cc6-268b3c4ee5ca None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:00.707125 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1992e-fb5a-4f4e-a869-7e6b4e51c00a None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:00.773263 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:00.822393 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea8f63-fcfc-4c54-8cc6-268b3c4ee5ca None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:00.829440 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1992e-fb5a-4f4e-a869-7e6b4e51c00a None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:00.869183 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792561a-8521-4e04-af16-f9605c111b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:00.869845 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792561a-8521-4e04-af16-f9605c111b1e None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:00.870123 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792561a-8521-4e04-af16-f9605c111b1e None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:00.870388 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792561a-8521-4e04-af16-f9605c111b1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:00.871185 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792561a-8521-4e04-af16-f9605c111b1e None admin] RBAC: Adding query filter params (interface=public, service_id=cf259120e2ea4b9e9fb12524e8172ce9, region_id=RegionOne) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:00.871488 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792561a-8521-4e04-af16-f9605c111b1e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:00.871786 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f14bd0-d3e6-424d-bc68-80e5ae9a9664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:00.872818 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f14bd0-d3e6-424d-bc68-80e5ae9a9664 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:00.872942 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792561a-8521-4e04-af16-f9605c111b1e None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:00.873413 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f14bd0-d3e6-424d-bc68-80e5ae9a9664 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:00.873883 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f14bd0-d3e6-424d-bc68-80e5ae9a9664 None admin] PATH_INFO: `/v3/services` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:00.874956 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f14bd0-d3e6-424d-bc68-80e5ae9a9664 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:00.877440 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f14bd0-d3e6-424d-bc68-80e5ae9a9664 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:00.883368 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 356/709] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Sep 21 11:50:00 2022] GET /identity/v3/endpoints?service_id=cf259120e2ea4b9e9fb12524e8172ce9&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:50:00.884432 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792561a-8521-4e04-af16-f9605c111b1e None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:00.889542 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 354/710] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 21 11:50:00 2022] GET /identity/v3/services => generated 1002 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 11:50:00.915974 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:01.012415 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32286d79-e6a0-43b6-96ca-bab42fc12f26 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:01.012990 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32286d79-e6a0-43b6-96ca-bab42fc12f26 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:01.012990 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32286d79-e6a0-43b6-96ca-bab42fc12f26 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:01.014267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 355/711] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 11:50:01.014456 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792561a-8521-4e04-af16-f9605c111b1e None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:01.019822 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071cd26-bf22-487c-8e47-5edb3165778b None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:01.020148 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071cd26-bf22-487c-8e47-5edb3165778b None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:01.020425 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071cd26-bf22-487c-8e47-5edb3165778b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:01.042316 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-a071cd26-bf22-487c-8e47-5edb3165778b None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:50:01.043449 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-a071cd26-bf22-487c-8e47-5edb3165778b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:50:01.066369 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376a27d-bfff-4ae3-8aec-cd889374ad01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:01.068299 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376a27d-bfff-4ae3-8aec-cd889374ad01 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:01.068583 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376a27d-bfff-4ae3-8aec-cd889374ad01 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:01.068848 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376a27d-bfff-4ae3-8aec-cd889374ad01 None admin] PATH_INFO: `/v3/services` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:01.069506 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376a27d-bfff-4ae3-8aec-cd889374ad01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:01.070906 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376a27d-bfff-4ae3-8aec-cd889374ad01 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:01.079466 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 357/712] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 21 11:50:00 2022] GET /identity/v3/services => generated 1002 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 11:50:01.138830 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 356/713] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:50:01 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 11:50:01.463274 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376a27d-bfff-4ae3-8aec-cd889374ad01 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:01.558883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:01.568931 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376a27d-bfff-4ae3-8aec-cd889374ad01 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:01.605078 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c34469-2581-4e6f-a052-3f7cd7a78e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:01.605700 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c34469-2581-4e6f-a052-3f7cd7a78e40 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:01.605968 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c34469-2581-4e6f-a052-3f7cd7a78e40 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:01.606229 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c34469-2581-4e6f-a052-3f7cd7a78e40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:01.617681 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c34469-2581-4e6f-a052-3f7cd7a78e40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:50:01.622544 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-63c34469-2581-4e6f-a052-3f7cd7a78e40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:50:01.622544 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:01.622544 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:50:01.622544 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:50:01.622544 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:50:01.622544 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:50:01.622544 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:50:01.622544 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:50:01.622544 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:50:01.622544 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:50:01.622544 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:50:01.622544 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:50:01.622544 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:50:01.622544 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:50:01.622544 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:50:01.622544 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:50:01.623545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:50:01.623545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:50:01.623545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:50:01.623545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:50:01.623545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:50:01.623545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:50:01.623545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:50:01.623545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:50:01.623545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:50:01.623545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:50:01.623545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:50:01.623545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:50:01.623545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:50:01.623545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:50:01.623545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:50:01.623545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:50:01.624456 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:50:01.624456 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:50:01.624456 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:50:01.624456 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:50:01.624456 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:50:01.624456 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:50:01.624456 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:50:01.624456 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:50:01.624456 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:50:01.624456 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:50:01.624456 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:50:01.624456 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:50:01.624456 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 358/714] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 11:50:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:50:01.630052 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071cd26-bf22-487c-8e47-5edb3165778b None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:01.688356 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:01.743190 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071cd26-bf22-487c-8e47-5edb3165778b None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:01.777700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079aad7-e5b9-41e0-9733-65ef625eac3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:01.778341 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079aad7-e5b9-41e0-9733-65ef625eac3e None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:01.778619 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079aad7-e5b9-41e0-9733-65ef625eac3e None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:01.778886 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079aad7-e5b9-41e0-9733-65ef625eac3e None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:01.779540 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079aad7-e5b9-41e0-9733-65ef625eac3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:01.779833 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079aad7-e5b9-41e0-9733-65ef625eac3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:01.781215 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079aad7-e5b9-41e0-9733-65ef625eac3e None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:01.796131 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 357/715] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:50:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:50:01.798087 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c34469-2581-4e6f-a052-3f7cd7a78e40 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:01.910136 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c34469-2581-4e6f-a052-3f7cd7a78e40 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:01.946889 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be768fe-ad86-4676-8fcc-d12431698158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:01.947584 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be768fe-ad86-4676-8fcc-d12431698158 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:01.947855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be768fe-ad86-4676-8fcc-d12431698158 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:01.948149 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be768fe-ad86-4676-8fcc-d12431698158 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:01.958026 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be768fe-ad86-4676-8fcc-d12431698158 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:01.959462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be768fe-ad86-4676-8fcc-d12431698158 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:02.099710 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-8be768fe-ad86-4676-8fcc-d12431698158 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:50:02.099710 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:02.099710 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:50:02.099710 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:50:02.099710 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:50:02.099710 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:50:02.099710 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:50:02.099710 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:50:02.099710 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:50:02.099710 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:50:02.099710 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:50:02.099710 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:50:02.099710 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:50:02.099710 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:50:02.099710 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:50:02.099710 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:50:02.103045 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:50:02.103045 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:50:02.103045 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:50:02.103045 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:50:02.103045 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:50:02.103045 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:50:02.103045 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:50:02.103045 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:50:02.103045 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:50:02.103045 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:50:02.103045 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:50:02.103045 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:50:02.103045 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:50:02.103045 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:50:02.103045 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:50:02.103045 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:50:02.103045 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:50:02.105249 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:50:02.105249 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:50:02.105249 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:50:02.105249 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 359/716] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:50:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:50:02.112010 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079aad7-e5b9-41e0-9733-65ef625eac3e None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:02.214594 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079aad7-e5b9-41e0-9733-65ef625eac3e None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:02.226170 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:02.251011 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51600a04-dad6-49a4-87fb-d6190818035e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:02.251606 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51600a04-dad6-49a4-87fb-d6190818035e None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:02.251880 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51600a04-dad6-49a4-87fb-d6190818035e None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:02.252174 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51600a04-dad6-49a4-87fb-d6190818035e None admin] PATH_INFO: `/v3/domains` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:02.252810 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51600a04-dad6-49a4-87fb-d6190818035e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:02.253165 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51600a04-dad6-49a4-87fb-d6190818035e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:02.254528 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51600a04-dad6-49a4-87fb-d6190818035e None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:02.269410 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 358/717] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:50:02.281056 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be768fe-ad86-4676-8fcc-d12431698158 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:02.284052 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:02.388607 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be768fe-ad86-4676-8fcc-d12431698158 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:02.424711 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6c54a-0fb0-4c44-a469-6598e8eb3a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:02.425386 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6c54a-0fb0-4c44-a469-6598e8eb3a1f None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:02.425663 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6c54a-0fb0-4c44-a469-6598e8eb3a1f None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:02.425923 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6c54a-0fb0-4c44-a469-6598e8eb3a1f None admin] PATH_INFO: `/v3/users/nova` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:02.433403 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6c54a-0fb0-4c44-a469-6598e8eb3a1f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:02.434909 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6c54a-0fb0-4c44-a469-6598e8eb3a1f None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:02.447439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-a2a6c54a-0fb0-4c44-a469-6598e8eb3a1f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 11:50:02.447439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:02.447439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:50:02.447439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:50:02.447439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:50:02.447439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:50:02.447439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:50:02.447439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:50:02.447439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:50:02.447439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:50:02.447439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:50:02.447439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:50:02.447439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 11:50:02.447439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 11:50:02.447439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 11:50:02.447439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 11:50:02.448497 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:50:02.448497 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:50:02.448497 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 11:50:02.448497 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:50:02.448497 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 11:50:02.448497 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:50:02.448497 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:50:02.448497 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:50:02.448497 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:50:02.448497 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:50:02.448497 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:50:02.448497 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:50:02.448497 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:50:02.448497 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:50:02.448497 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:50:02.448497 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:50:02.448497 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:50:02.448497 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:50:02.449919 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:50:02.449919 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:50:02.449919 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 11:50:02.449919 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 11:50:02.449919 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 11:50:02.449919 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 11:50:02.449919 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 11:50:02.449919 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 11:50:02.449919 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 11:50:02.449919 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:50:02.449919 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 360/718] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Sep 21 11:50:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:50:02.456533 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51600a04-dad6-49a4-87fb-d6190818035e None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:02.565691 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51600a04-dad6-49a4-87fb-d6190818035e None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:02.601392 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f382e1-45ff-457a-849a-33464e341714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:02.602151 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f382e1-45ff-457a-849a-33464e341714 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:02.603495 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f382e1-45ff-457a-849a-33464e341714 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:02.603828 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f382e1-45ff-457a-849a-33464e341714 None admin] PATH_INFO: `/v3/users` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:02.604588 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f382e1-45ff-457a-849a-33464e341714 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:02.604932 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f382e1-45ff-457a-849a-33464e341714 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:02.606461 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f382e1-45ff-457a-849a-33464e341714 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:02.624796 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 359/719] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Sep 21 11:50:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:50:02.633412 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6c54a-0fb0-4c44-a469-6598e8eb3a1f None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:02.699874 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:02.742328 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6c54a-0fb0-4c44-a469-6598e8eb3a1f None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:02.780622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313a4fe-18ce-4fe2-80fb-f97d42ee58f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:02.781211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313a4fe-18ce-4fe2-80fb-f97d42ee58f6 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:02.781481 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313a4fe-18ce-4fe2-80fb-f97d42ee58f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:02.781751 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313a4fe-18ce-4fe2-80fb-f97d42ee58f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:02.852312 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313a4fe-18ce-4fe2-80fb-f97d42ee58f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:02.853827 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313a4fe-18ce-4fe2-80fb-f97d42ee58f6 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:02.918713 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:02.935099 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34af9e0-40a3-40c2-a234-098dd06371ef None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:02.935427 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34af9e0-40a3-40c2-a234-098dd06371ef None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:02.935639 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34af9e0-40a3-40c2-a234-098dd06371ef None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:02.937279 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 360/720] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 11:50:02.942279 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345e3e9-a20b-492c-9a51-ad0edcff8740 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:02.942559 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345e3e9-a20b-492c-9a51-ad0edcff8740 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:02.942829 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345e3e9-a20b-492c-9a51-ad0edcff8740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:02.964599 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-3345e3e9-a20b-492c-9a51-ad0edcff8740 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:50:02.965370 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 361/721] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:50:02 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 11:50:02.965704 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-3345e3e9-a20b-492c-9a51-ad0edcff8740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:50:02.973697 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313a4fe-18ce-4fe2-80fb-f97d42ee58f6 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:02.996497 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:03.056786 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 361/722] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:50:02 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 11:50:03.092539 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313a4fe-18ce-4fe2-80fb-f97d42ee58f6 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:03.129414 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26b095-54ae-43c5-86d9-8a46529cd116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:03.130818 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26b095-54ae-43c5-86d9-8a46529cd116 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:03.131249 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26b095-54ae-43c5-86d9-8a46529cd116 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:03.131708 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26b095-54ae-43c5-86d9-8a46529cd116 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:03.145232 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26b095-54ae-43c5-86d9-8a46529cd116 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:03.147133 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26b095-54ae-43c5-86d9-8a46529cd116 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:03.166605 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-fc26b095-54ae-43c5-86d9-8a46529cd116 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:50:03.166605 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:03.166605 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:50:03.166605 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:50:03.166605 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:50:03.166605 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:50:03.166605 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:50:03.166605 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:50:03.166605 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:50:03.166605 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:50:03.166605 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:50:03.166605 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:50:03.166605 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:50:03.166605 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:50:03.166605 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:50:03.166605 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:50:03.167872 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:50:03.167872 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:50:03.167872 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:50:03.167872 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:50:03.167872 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:50:03.167872 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:50:03.167872 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:50:03.167872 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:50:03.167872 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:50:03.167872 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:50:03.167872 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:50:03.167872 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:50:03.167872 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:50:03.167872 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:50:03.167872 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:50:03.167872 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:50:03.167872 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:50:03.168908 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:50:03.168908 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:50:03.168908 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:50:03.174085 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 362/723] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:50:03.175760 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345e3e9-a20b-492c-9a51-ad0edcff8740 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:03.283257 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345e3e9-a20b-492c-9a51-ad0edcff8740 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:03.320232 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2ca13-fd37-431d-bb78-4c4588188d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:03.321219 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2ca13-fd37-431d-bb78-4c4588188d69 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:03.321701 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2ca13-fd37-431d-bb78-4c4588188d69 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:03.322201 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2ca13-fd37-431d-bb78-4c4588188d69 None admin] PATH_INFO: `/v3/domains` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:03.323099 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2ca13-fd37-431d-bb78-4c4588188d69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:03.323612 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2ca13-fd37-431d-bb78-4c4588188d69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:03.325231 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2ca13-fd37-431d-bb78-4c4588188d69 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:03.342116 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 362/724] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:50:03.345026 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26b095-54ae-43c5-86d9-8a46529cd116 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:03.366618 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:03.387207 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2ca13-fd37-431d-bb78-4c4588188d69 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:03.407656 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:03.486040 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26b095-54ae-43c5-86d9-8a46529cd116 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:03.507200 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2ca13-fd37-431d-bb78-4c4588188d69 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:03.534509 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec99a6-4772-421b-a721-3f7d30728f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:03.535734 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec99a6-4772-421b-a721-3f7d30728f34 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:03.536449 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec99a6-4772-421b-a721-3f7d30728f34 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:03.537421 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec99a6-4772-421b-a721-3f7d30728f34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:03.546475 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f19a3-10c8-4629-a829-dae47afcabc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:03.547161 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f19a3-10c8-4629-a829-dae47afcabc1 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:03.547439 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f19a3-10c8-4629-a829-dae47afcabc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:03.547714 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f19a3-10c8-4629-a829-dae47afcabc1 None admin] PATH_INFO: `/v3/services/image` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:03.548382 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f19a3-10c8-4629-a829-dae47afcabc1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:03.549748 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f19a3-10c8-4629-a829-dae47afcabc1 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:03.550292 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec99a6-4772-421b-a721-3f7d30728f34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:03.553166 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec99a6-4772-421b-a721-3f7d30728f34 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:03.559294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-345f19a3-10c8-4629-a829-dae47afcabc1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 11:50:03.559294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:03.559294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 11:50:03.559294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 11:50:03.559294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 11:50:03.559294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 11:50:03.559294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 11:50:03.559294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:50:03.559294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 11:50:03.559294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:50:03.559294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 11:50:03.559294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:50:03.559294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:03.559294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:50:03.559294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:50:03.559294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:50:03.559294 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:50:03.560852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:50:03.560852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:50:03.560852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:50:03.560852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:50:03.560852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:50:03.560852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:50:03.560852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 11:50:03.560852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 11:50:03.560852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 11:50:03.560852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 11:50:03.560852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:50:03.560852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:50:03.560852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:50:03.560852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:50:03.560852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:50:03.560852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:50:03.562275 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:50:03.562275 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:50:03.562275 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:50:03.562275 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:50:03.562275 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:50:03.562275 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:50:03.562275 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:50:03.562275 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:50:03.562275 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:50:03.562275 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:50:03.562275 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 11:50:03.562275 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:50:03.562275 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 11:50:03.562275 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:50:03.562275 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 363/725] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Sep 21 11:50:03 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:50:03.569760 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f19a3-10c8-4629-a829-dae47afcabc1 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:03.577073 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-b9ec99a6-4772-421b-a721-3f7d30728f34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:50:03.577073 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:03.577073 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:50:03.577073 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:50:03.577073 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:50:03.577073 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:50:03.577073 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:50:03.577073 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:50:03.577073 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:50:03.577073 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:50:03.577073 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:50:03.577073 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:50:03.577073 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 11:50:03.577073 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 11:50:03.577073 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 11:50:03.578097 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 11:50:03.578097 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:50:03.578097 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:50:03.578097 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:50:03.578097 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:50:03.578097 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:50:03.578097 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:50:03.578097 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:50:03.578097 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:50:03.578097 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:50:03.578097 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:50:03.578097 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:50:03.578097 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:50:03.578097 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:50:03.578097 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:50:03.578097 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:50:03.578097 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:50:03.579004 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 11:50:03.579004 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 11:50:03.579004 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 11:50:03.579004 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 11:50:03.579004 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 11:50:03.579004 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 11:50:03.579004 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:50:03.579004 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:50:03.581542 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 363/726] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:50:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:50:03.582904 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a60098-99bf-48f9-adc1-68b98edeeb43 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:03.583331 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a60098-99bf-48f9-adc1-68b98edeeb43 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:03.583729 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a60098-99bf-48f9-adc1-68b98edeeb43 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:03.588109 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 364/727] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:50:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:50:03.592010 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182fa29-c089-4b39-8be3-d2d5fa1f438d None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:03.592304 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182fa29-c089-4b39-8be3-d2d5fa1f438d None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:03.592568 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182fa29-c089-4b39-8be3-d2d5fa1f438d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:03.610794 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-a182fa29-c089-4b39-8be3-d2d5fa1f438d None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:50:03.611965 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-a182fa29-c089-4b39-8be3-d2d5fa1f438d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:50:03.657582 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:03.677119 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f19a3-10c8-4629-a829-dae47afcabc1 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:03.678808 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 365/728] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:50:03 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 11:50:03.679632 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182fa29-c089-4b39-8be3-d2d5fa1f438d None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:03.688636 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:03.714434 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92242f19-452c-4ba6-b1ca-460ad6fa9e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:03.715033 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92242f19-452c-4ba6-b1ca-460ad6fa9e1c None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:03.715305 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92242f19-452c-4ba6-b1ca-460ad6fa9e1c None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:03.715573 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92242f19-452c-4ba6-b1ca-460ad6fa9e1c None admin] PATH_INFO: `/v3/services` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:03.716228 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92242f19-452c-4ba6-b1ca-460ad6fa9e1c None admin] RBAC: Adding query filter params (name=image) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:03.716526 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92242f19-452c-4ba6-b1ca-460ad6fa9e1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:03.718064 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92242f19-452c-4ba6-b1ca-460ad6fa9e1c None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:03.722780 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 364/729] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:50:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:50:03.724094 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009de3ee-582e-4d75-a0de-be33ba039516 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:03.724377 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009de3ee-582e-4d75-a0de-be33ba039516 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:03.724649 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009de3ee-582e-4d75-a0de-be33ba039516 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:03.730354 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 365/730] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:50:03.730354 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009de3ee-582e-4d75-a0de-be33ba039516 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:03.795323 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182fa29-c089-4b39-8be3-d2d5fa1f438d None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:03.829239 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87f8b5-a1d2-4215-8992-aab112cbdd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:03.829829 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87f8b5-a1d2-4215-8992-aab112cbdd38 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:03.830098 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87f8b5-a1d2-4215-8992-aab112cbdd38 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:03.830670 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87f8b5-a1d2-4215-8992-aab112cbdd38 None admin] PATH_INFO: `/v3/projects` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:03.831030 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87f8b5-a1d2-4215-8992-aab112cbdd38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:03.831321 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87f8b5-a1d2-4215-8992-aab112cbdd38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:03.832813 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87f8b5-a1d2-4215-8992-aab112cbdd38 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:03.845429 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 366/731] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 11:50:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:50:03.846397 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b39cf-90f5-4c57-a61e-74c06ef4a842 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:03.846673 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b39cf-90f5-4c57-a61e-74c06ef4a842 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:03.846940 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b39cf-90f5-4c57-a61e-74c06ef4a842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:03.854550 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009de3ee-582e-4d75-a0de-be33ba039516 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:03.865981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-5e8b39cf-90f5-4c57-a61e-74c06ef4a842 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:50:03.867137 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-5e8b39cf-90f5-4c57-a61e-74c06ef4a842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:50:03.898858 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cac50d-90a3-47c0-b65b-d1de14604113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:03.899471 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cac50d-90a3-47c0-b65b-d1de14604113 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:03.899735 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cac50d-90a3-47c0-b65b-d1de14604113 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:03.900035 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cac50d-90a3-47c0-b65b-d1de14604113 None admin] PATH_INFO: `/v3/services` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:03.900713 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cac50d-90a3-47c0-b65b-d1de14604113 None admin] RBAC: Adding query filter params (type=image) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:03.901009 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cac50d-90a3-47c0-b65b-d1de14604113 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:03.902362 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cac50d-90a3-47c0-b65b-d1de14604113 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:03.909976 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 366/732] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:50:03 2022] GET /identity/v3/services?type=image => generated 350 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:50:03.910613 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cac50d-90a3-47c0-b65b-d1de14604113 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:03.922512 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:03.935573 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:03.946846 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 367/733] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:50:03 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 11:50:03.947723 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b39cf-90f5-4c57-a61e-74c06ef4a842 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:04.035434 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cac50d-90a3-47c0-b65b-d1de14604113 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:04.069698 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433917a7-2cc8-424b-aca5-641817768e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:04.070210 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433917a7-2cc8-424b-aca5-641817768e4b None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:04.070481 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433917a7-2cc8-424b-aca5-641817768e4b None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:04.070741 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433917a7-2cc8-424b-aca5-641817768e4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:04.071454 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433917a7-2cc8-424b-aca5-641817768e4b None admin] RBAC: Adding query filter params (role.id=d1f3d1431da145709a5e9b374f3b403d, scope.project.id=1fd87b195f7c46d2a0d621124acce331, user.id=c683dcd33e5b40fabbbf12c3dcf97eb1) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:04.071771 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433917a7-2cc8-424b-aca5-641817768e4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:04.073235 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433917a7-2cc8-424b-aca5-641817768e4b None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:04.073434 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b39cf-90f5-4c57-a61e-74c06ef4a842 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:04.079533 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 367/734] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 11:50:03 2022] GET /identity/v3/role_assignments?user.id=c683dcd33e5b40fabbbf12c3dcf97eb1&scope.project.id=1fd87b195f7c46d2a0d621124acce331&role.id=d1f3d1431da145709a5e9b374f3b403d => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:50:04.080338 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433917a7-2cc8-424b-aca5-641817768e4b None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:04.118622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc3dfb-48a2-4acc-9c2e-fd58da4b09bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:04.119550 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc3dfb-48a2-4acc-9c2e-fd58da4b09bb None admin] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:04.119922 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc3dfb-48a2-4acc-9c2e-fd58da4b09bb None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:04.120437 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc3dfb-48a2-4acc-9c2e-fd58da4b09bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:04.121194 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc3dfb-48a2-4acc-9c2e-fd58da4b09bb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:04.122670 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc3dfb-48a2-4acc-9c2e-fd58da4b09bb None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:04.164252 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 368/735] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 11:50:03 2022] POST /identity/v3/endpoints => generated 327 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 11:50:04.191520 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:04.239961 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433917a7-2cc8-424b-aca5-641817768e4b None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:04.288517 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc3dfb-48a2-4acc-9c2e-fd58da4b09bb None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:04.298033 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963c5cf-bcc0-40fc-ade1-5f29bf1d9b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:04.298687 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963c5cf-bcc0-40fc-ade1-5f29bf1d9b2a None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:04.298960 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963c5cf-bcc0-40fc-ade1-5f29bf1d9b2a None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:04.299228 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963c5cf-bcc0-40fc-ade1-5f29bf1d9b2a None admin] PATH_INFO: `/v3/services/network` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:04.299817 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963c5cf-bcc0-40fc-ade1-5f29bf1d9b2a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:04.301273 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963c5cf-bcc0-40fc-ade1-5f29bf1d9b2a None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:04.312107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-8963c5cf-bcc0-40fc-ade1-5f29bf1d9b2a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 11:50:04.312107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:04.312107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 11:50:04.312107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 11:50:04.312107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 11:50:04.312107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 11:50:04.312107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 11:50:04.312107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:50:04.312107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 11:50:04.312107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:50:04.312107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 11:50:04.312107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:50:04.312107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:04.312107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:50:04.312107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:50:04.312107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:50:04.312107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:50:04.313230 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:50:04.313230 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:50:04.313230 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:50:04.313230 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:50:04.313230 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:50:04.313230 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:50:04.313230 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 11:50:04.313230 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 11:50:04.313230 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 11:50:04.313230 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 11:50:04.313230 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:50:04.313230 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:50:04.313230 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:50:04.313230 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:50:04.313230 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:50:04.313230 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:50:04.314714 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:50:04.314714 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:50:04.314714 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:50:04.314714 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:50:04.314714 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:50:04.314714 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:50:04.314714 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:50:04.314714 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:50:04.314714 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:50:04.314714 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:50:04.314714 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 11:50:04.314714 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:50:04.314714 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 11:50:04.314714 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:50:04.314714 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 368/736] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:50:04 2022] GET /identity/v3/services/network => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:50:04.321031 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963c5cf-bcc0-40fc-ade1-5f29bf1d9b2a None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:04.375348 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:04.448034 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc3dfb-48a2-4acc-9c2e-fd58da4b09bb None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:04.459382 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963c5cf-bcc0-40fc-ade1-5f29bf1d9b2a None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:04.486756 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30468b-f709-46b6-ad89-04d2b0f25b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:04.487378 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30468b-f709-46b6-ad89-04d2b0f25b6e None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:04.487648 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30468b-f709-46b6-ad89-04d2b0f25b6e None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:04.487913 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30468b-f709-46b6-ad89-04d2b0f25b6e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:04.488532 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30468b-f709-46b6-ad89-04d2b0f25b6e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:04.489882 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30468b-f709-46b6-ad89-04d2b0f25b6e None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:04.502946 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-9f30468b-f709-46b6-ad89-04d2b0f25b6e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 11:50:04.502946 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:04.502946 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 11:50:04.502946 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 11:50:04.502946 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 11:50:04.502946 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 11:50:04.502946 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 11:50:04.502946 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:50:04.502946 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 11:50:04.502946 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:50:04.502946 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 11:50:04.502946 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:50:04.502946 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:04.502946 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:50:04.502946 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:50:04.502946 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:50:04.502946 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:50:04.504258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:50:04.504258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:50:04.504258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:50:04.504258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:50:04.504258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:50:04.504258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:50:04.504258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 11:50:04.504258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 11:50:04.504258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 11:50:04.504258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 11:50:04.504258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:50:04.504258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:50:04.504258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:50:04.504258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:50:04.504258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:50:04.504258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:50:04.505596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:50:04.505596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:50:04.505596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:50:04.505596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:50:04.505596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:50:04.505596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:50:04.505596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:50:04.505596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:50:04.505596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:50:04.505596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:50:04.505596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 11:50:04.505596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:50:04.505596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 11:50:04.505596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:50:04.505596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 369/737] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Sep 21 11:50:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:50:04.507648 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bf4af-824e-4949-9890-e67295cf2e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:04.508604 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bf4af-824e-4949-9890-e67295cf2e85 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:04.508604 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bf4af-824e-4949-9890-e67295cf2e85 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:04.508784 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bf4af-824e-4949-9890-e67295cf2e85 None admin] PATH_INFO: `/v3/services` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:04.509467 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368bf4af-824e-4949-9890-e67295cf2e85 None admin] RBAC: Adding query filter params (name=network) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:04.509697 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368bf4af-824e-4949-9890-e67295cf2e85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:04.511046 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368bf4af-824e-4949-9890-e67295cf2e85 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:04.512900 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30468b-f709-46b6-ad89-04d2b0f25b6e None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:04.514723 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:04.519199 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 369/738] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 21 11:50:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:50:04.524320 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bf4af-824e-4949-9890-e67295cf2e85 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:04.638158 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30468b-f709-46b6-ad89-04d2b0f25b6e None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:04.654516 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bf4af-824e-4949-9890-e67295cf2e85 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:04.656823 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:04.683102 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0fd3f-9c0e-432f-aede-df139359ede4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:04.683937 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0fd3f-9c0e-432f-aede-df139359ede4 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:04.684245 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0fd3f-9c0e-432f-aede-df139359ede4 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:04.684510 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0fd3f-9c0e-432f-aede-df139359ede4 None admin] PATH_INFO: `/v3/services` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:04.685135 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de0fd3f-9c0e-432f-aede-df139359ede4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:04.685874 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de0fd3f-9c0e-432f-aede-df139359ede4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:04.687510 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de0fd3f-9c0e-432f-aede-df139359ede4 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:04.698168 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2620d-aa52-4829-ada3-7239677b6731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:04.698815 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 370/739] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Sep 21 11:50:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:50:04.699685 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0fd3f-9c0e-432f-aede-df139359ede4 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:04.699798 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2620d-aa52-4829-ada3-7239677b6731 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:04.700383 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2620d-aa52-4829-ada3-7239677b6731 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:04.700861 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2620d-aa52-4829-ada3-7239677b6731 None admin] PATH_INFO: `/v3/services` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:04.701716 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab2620d-aa52-4829-ada3-7239677b6731 None admin] RBAC: Adding query filter params (type=network) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:04.702223 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab2620d-aa52-4829-ada3-7239677b6731 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:04.703806 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab2620d-aa52-4829-ada3-7239677b6731 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:04.709789 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 370/740] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 21 11:50:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:50:04.714764 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2620d-aa52-4829-ada3-7239677b6731 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:04.789999 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:04.829327 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0fd3f-9c0e-432f-aede-df139359ede4 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:04.842614 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2620d-aa52-4829-ada3-7239677b6731 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:04.874412 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccb31d-fda3-40a5-bbe2-9fed54d82b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:04.875013 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccb31d-fda3-40a5-bbe2-9fed54d82b97 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:04.875323 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccb31d-fda3-40a5-bbe2-9fed54d82b97 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:04.875542 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccb31d-fda3-40a5-bbe2-9fed54d82b97 None admin] PATH_INFO: `/v3/services` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:04.876595 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccb31d-fda3-40a5-bbe2-9fed54d82b97 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:04.876902 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccb31d-fda3-40a5-bbe2-9fed54d82b97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:04.878552 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccb31d-fda3-40a5-bbe2-9fed54d82b97 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:04.881794 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aac21e-3908-4617-bebf-b31ff0a28deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:04.882630 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aac21e-3908-4617-bebf-b31ff0a28deb None admin] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:04.883112 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aac21e-3908-4617-bebf-b31ff0a28deb None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:04.883583 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aac21e-3908-4617-bebf-b31ff0a28deb None admin] PATH_INFO: `/v3/endpoints` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:04.884605 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aac21e-3908-4617-bebf-b31ff0a28deb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:04.886268 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aac21e-3908-4617-bebf-b31ff0a28deb None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:04.888205 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 371/741] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Sep 21 11:50:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:50:04.889218 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccb31d-fda3-40a5-bbe2-9fed54d82b97 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:04.913455 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 371/742] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 11:50:04 2022] POST /identity/v3/endpoints => generated 337 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 11:50:04.956410 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:05.025285 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccb31d-fda3-40a5-bbe2-9fed54d82b97 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:05.071773 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d96b7-49d1-47cc-a3e6-c20952188d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:05.072415 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d96b7-49d1-47cc-a3e6-c20952188d76 None admin] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:05.072689 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d96b7-49d1-47cc-a3e6-c20952188d76 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:05.072952 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d96b7-49d1-47cc-a3e6-c20952188d76 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:05.073627 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d96b7-49d1-47cc-a3e6-c20952188d76 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:05.075204 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d96b7-49d1-47cc-a3e6-c20952188d76 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:05.101367 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 372/743] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 11:50:04 2022] POST /identity/v3/endpoints => generated 346 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 11:50:06.651440 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43071771-6767-4265-a0b9-a1dba0d97310 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:06.652179 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43071771-6767-4265-a0b9-a1dba0d97310 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:06.652179 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43071771-6767-4265-a0b9-a1dba0d97310 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:06.653458 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 372/744] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:50:06.658419 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984d74c-2ccd-4180-b1ab-bcfbbe19de01 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:06.658820 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984d74c-2ccd-4180-b1ab-bcfbbe19de01 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:06.659006 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984d74c-2ccd-4180-b1ab-bcfbbe19de01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:06.678157 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-8984d74c-2ccd-4180-b1ab-bcfbbe19de01 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:50:06.679778 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-8984d74c-2ccd-4180-b1ab-bcfbbe19de01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:50:06.752657 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 373/745] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:50:06 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 11:50:06.769494 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2f130-56f0-407d-a9a9-f8f955e14c07 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:06.769780 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2f130-56f0-407d-a9a9-f8f955e14c07 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:06.770056 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2f130-56f0-407d-a9a9-f8f955e14c07 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:06.771502 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 373/746] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:50:06.776673 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83803e-0877-41b6-b0b6-8ba2f1caf76d None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:06.776961 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83803e-0877-41b6-b0b6-8ba2f1caf76d None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:06.777232 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83803e-0877-41b6-b0b6-8ba2f1caf76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:06.795316 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-0e83803e-0877-41b6-b0b6-8ba2f1caf76d None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:50:06.797159 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-0e83803e-0877-41b6-b0b6-8ba2f1caf76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:50:06.814502 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:06.869871 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 374/747] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:50:06 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 11:50:07.082529 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2f130-56f0-407d-a9a9-f8f955e14c07 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:07.192588 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2f130-56f0-407d-a9a9-f8f955e14c07 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:07.198030 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83803e-0877-41b6-b0b6-8ba2f1caf76d None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:07.211230 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:07.231931 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8af49-6b62-4cb3-b066-5e7815490af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:07.232584 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8af49-6b62-4cb3-b066-5e7815490af3 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:07.232870 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8af49-6b62-4cb3-b066-5e7815490af3 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:07.233138 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8af49-6b62-4cb3-b066-5e7815490af3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:07.233712 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8af49-6b62-4cb3-b066-5e7815490af3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:07.235079 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8af49-6b62-4cb3-b066-5e7815490af3 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:07.244360 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-72c8af49-6b62-4cb3-b066-5e7815490af3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 11:50:07.244360 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:07.244360 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 11:50:07.244360 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 11:50:07.244360 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 11:50:07.244360 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 11:50:07.244360 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 11:50:07.244360 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:50:07.244360 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 11:50:07.244360 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:50:07.244360 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 11:50:07.244360 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:50:07.244360 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:07.244360 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:50:07.244360 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:50:07.244360 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:50:07.245340 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:50:07.245340 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:50:07.245340 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:50:07.245340 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:50:07.245340 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:50:07.245340 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:50:07.245340 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:50:07.245340 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 11:50:07.245340 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 11:50:07.245340 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 11:50:07.245340 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 11:50:07.245340 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:50:07.245340 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:50:07.245340 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:50:07.245340 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:50:07.245340 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:50:07.245340 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:50:07.246267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:50:07.246267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:50:07.246267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:50:07.246267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:50:07.246267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:50:07.246267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:50:07.246267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:50:07.246267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:50:07.246267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:50:07.246267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:50:07.246267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 11:50:07.246267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:50:07.246267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 11:50:07.246267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:50:07.246267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 374/748] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Sep 21 11:50:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:50:07.251139 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8af49-6b62-4cb3-b066-5e7815490af3 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:07.305437 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83803e-0877-41b6-b0b6-8ba2f1caf76d None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:07.340132 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af75a9-0dc1-4386-9b65-25b4e93d6e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:07.340725 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af75a9-0dc1-4386-9b65-25b4e93d6e66 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:07.340999 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af75a9-0dc1-4386-9b65-25b4e93d6e66 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:07.341263 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af75a9-0dc1-4386-9b65-25b4e93d6e66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:07.359051 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8af49-6b62-4cb3-b066-5e7815490af3 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:07.359388 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:07.396342 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204e047-a759-4be8-96b3-3eebd9414f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:07.397011 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204e047-a759-4be8-96b3-3eebd9414f19 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:07.397293 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204e047-a759-4be8-96b3-3eebd9414f19 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:07.397559 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204e047-a759-4be8-96b3-3eebd9414f19 None admin] PATH_INFO: `/v3/services` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:07.398187 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204e047-a759-4be8-96b3-3eebd9414f19 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:07.398486 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204e047-a759-4be8-96b3-3eebd9414f19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:07.399934 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204e047-a759-4be8-96b3-3eebd9414f19 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:07.404642 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 375/749] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 21 11:50:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:50:07.410128 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204e047-a759-4be8-96b3-3eebd9414f19 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:07.413625 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af75a9-0dc1-4386-9b65-25b4e93d6e66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:07.415485 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af75a9-0dc1-4386-9b65-25b4e93d6e66 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:07.462793 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:07.520916 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204e047-a759-4be8-96b3-3eebd9414f19 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:07.523100 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 375/750] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:50:07 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 21 11:50:07.528606 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af75a9-0dc1-4386-9b65-25b4e93d6e66 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:07.557654 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c832d-0b37-4652-8749-38ee488e6e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:07.558253 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c832d-0b37-4652-8749-38ee488e6e94 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:07.558523 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c832d-0b37-4652-8749-38ee488e6e94 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:07.558796 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c832d-0b37-4652-8749-38ee488e6e94 None admin] PATH_INFO: `/v3/services` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:07.559411 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c832d-0b37-4652-8749-38ee488e6e94 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:07.559709 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c832d-0b37-4652-8749-38ee488e6e94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:07.561087 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c832d-0b37-4652-8749-38ee488e6e94 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:07.565359 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 376/751] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 21 11:50:07 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:50:07.566466 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ffa21-1168-463a-b440-99669caa4714 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:07.566742 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ffa21-1168-463a-b440-99669caa4714 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:07.567008 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ffa21-1168-463a-b440-99669caa4714 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:07.568360 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 377/752] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:50:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:50:07.579025 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af6875-3d7c-4aee-81c7-dac659416b72 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:07.579323 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af6875-3d7c-4aee-81c7-dac659416b72 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:07.579712 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af6875-3d7c-4aee-81c7-dac659416b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:07.589852 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:07.599161 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-d0af6875-3d7c-4aee-81c7-dac659416b72 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:50:07.600958 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-d0af6875-3d7c-4aee-81c7-dac659416b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:50:07.641745 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af75a9-0dc1-4386-9b65-25b4e93d6e66 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:07.676319 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 378/753] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:50:07 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 11:50:07.683046 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a55c1-e6d4-4df8-82d8-cebd31dfc45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:07.683757 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a55c1-e6d4-4df8-82d8-cebd31dfc45c None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:07.684130 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a55c1-e6d4-4df8-82d8-cebd31dfc45c None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:07.684401 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a55c1-e6d4-4df8-82d8-cebd31dfc45c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:07.695583 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a55c1-e6d4-4df8-82d8-cebd31dfc45c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:07.697192 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a55c1-e6d4-4df8-82d8-cebd31dfc45c None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:07.712944 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-0c2a55c1-e6d4-4df8-82d8-cebd31dfc45c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:50:07.712944 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:07.712944 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:50:07.712944 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:50:07.712944 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:50:07.712944 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:50:07.712944 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:50:07.712944 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:50:07.712944 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:50:07.712944 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:50:07.712944 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:50:07.712944 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:50:07.712944 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:50:07.712944 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:50:07.712944 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:50:07.712944 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:50:07.714151 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:50:07.714151 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:50:07.714151 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:50:07.714151 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:50:07.714151 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:50:07.714151 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:50:07.714151 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:50:07.714151 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:50:07.714151 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:50:07.714151 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:50:07.714151 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:50:07.714151 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:50:07.714151 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:50:07.714151 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:50:07.714151 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:50:07.714151 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:50:07.714151 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:50:07.715156 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:50:07.715156 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:50:07.715156 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:50:07.715952 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 376/754] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 11:50:07.720065 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af6875-3d7c-4aee-81c7-dac659416b72 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:07.767006 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:07.834979 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af6875-3d7c-4aee-81c7-dac659416b72 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:07.869901 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47743be7-7faf-4c9d-8033-995a858f20c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:07.870841 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47743be7-7faf-4c9d-8033-995a858f20c9 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:07.871343 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47743be7-7faf-4c9d-8033-995a858f20c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:07.871855 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47743be7-7faf-4c9d-8033-995a858f20c9 None admin] PATH_INFO: `/v3/domains` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:07.872735 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47743be7-7faf-4c9d-8033-995a858f20c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:07.873250 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47743be7-7faf-4c9d-8033-995a858f20c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:07.874807 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47743be7-7faf-4c9d-8033-995a858f20c9 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:07.886258 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 379/755] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:50:08.011675 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a55c1-e6d4-4df8-82d8-cebd31dfc45c None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:08.121752 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a55c1-e6d4-4df8-82d8-cebd31dfc45c None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:08.123304 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:08.158312 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ede157-a6fc-4bd4-8790-75fb7a23e4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:08.158933 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ede157-a6fc-4bd4-8790-75fb7a23e4f3 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:08.159207 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ede157-a6fc-4bd4-8790-75fb7a23e4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:08.159472 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ede157-a6fc-4bd4-8790-75fb7a23e4f3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:08.160084 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ede157-a6fc-4bd4-8790-75fb7a23e4f3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:08.161442 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ede157-a6fc-4bd4-8790-75fb7a23e4f3 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:08.172301 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-38ede157-a6fc-4bd4-8790-75fb7a23e4f3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 11:50:08.172301 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:08.172301 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 11:50:08.172301 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 11:50:08.172301 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 11:50:08.172301 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 11:50:08.172301 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 11:50:08.172301 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:50:08.172301 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 11:50:08.172301 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:50:08.172301 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 11:50:08.172301 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:50:08.172301 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:08.172301 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:50:08.172301 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:50:08.172301 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:50:08.172301 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:50:08.173359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:50:08.173359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:50:08.173359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:50:08.173359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:50:08.173359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:50:08.173359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:50:08.173359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 11:50:08.173359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 11:50:08.173359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 11:50:08.173359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 11:50:08.173359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:50:08.173359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:50:08.173359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:50:08.173359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:50:08.173359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:50:08.173359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:50:08.174257 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:50:08.174257 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:50:08.174257 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:50:08.174257 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:50:08.174257 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:50:08.174257 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:50:08.174257 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:50:08.174257 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:50:08.174257 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:50:08.174257 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:50:08.174257 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 11:50:08.174257 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:50:08.174257 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 11:50:08.174257 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:50:08.174257 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 377/756] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 11:50:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:50:08.179266 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47743be7-7faf-4c9d-8033-995a858f20c9 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:08.294143 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:08.297262 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47743be7-7faf-4c9d-8033-995a858f20c9 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:08.329657 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd8e31-7f86-4481-a937-0d7fd382d10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:08.330250 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd8e31-7f86-4481-a937-0d7fd382d10e None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:08.330526 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd8e31-7f86-4481-a937-0d7fd382d10e None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:08.330795 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd8e31-7f86-4481-a937-0d7fd382d10e None admin] PATH_INFO: `/v3/services` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:08.331412 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd8e31-7f86-4481-a937-0d7fd382d10e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:08.331711 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd8e31-7f86-4481-a937-0d7fd382d10e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:08.333117 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd8e31-7f86-4481-a937-0d7fd382d10e None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:08.338015 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 380/757] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 11:50:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:50:08.343556 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ede157-a6fc-4bd4-8790-75fb7a23e4f3 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:08.442699 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ede157-a6fc-4bd4-8790-75fb7a23e4f3 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:08.476641 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd379d-5ed4-4d74-b324-455a6d2f9dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:08.477228 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd379d-5ed4-4d74-b324-455a6d2f9dd6 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:08.477504 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd379d-5ed4-4d74-b324-455a6d2f9dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:08.477773 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd379d-5ed4-4d74-b324-455a6d2f9dd6 None admin] PATH_INFO: `/v3/services` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:08.478390 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd379d-5ed4-4d74-b324-455a6d2f9dd6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:08.478689 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd379d-5ed4-4d74-b324-455a6d2f9dd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:08.480079 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd379d-5ed4-4d74-b324-455a6d2f9dd6 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:08.484366 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 378/758] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 11:50:08 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:50:09.987460 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf61f37-a757-46df-96f3-ac4c60011d34 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:09.988016 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf61f37-a757-46df-96f3-ac4c60011d34 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:09.988016 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf61f37-a757-46df-96f3-ac4c60011d34 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:09.989332 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 381/759] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:50:09.995288 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90beb380-d91e-4884-aa9f-35d5edb1e932 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:09.995761 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90beb380-d91e-4884-aa9f-35d5edb1e932 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:09.995885 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90beb380-d91e-4884-aa9f-35d5edb1e932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:10.013530 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-90beb380-d91e-4884-aa9f-35d5edb1e932 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:50:10.014692 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-90beb380-d91e-4884-aa9f-35d5edb1e932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:50:10.037704 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:10.081423 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 379/760] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:50:09 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 11:50:10.400651 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf61f37-a757-46df-96f3-ac4c60011d34 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:10.504296 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf61f37-a757-46df-96f3-ac4c60011d34 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:10.537028 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae6449-c055-4685-9830-69a32036072d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:10.538207 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae6449-c055-4685-9830-69a32036072d None admin] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:10.538480 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae6449-c055-4685-9830-69a32036072d None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:10.539002 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae6449-c055-4685-9830-69a32036072d None admin] PATH_INFO: `/v3/services` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:10.539647 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae6449-c055-4685-9830-69a32036072d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:10.541048 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae6449-c055-4685-9830-69a32036072d None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:10.554716 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 382/761] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 21 11:50:10 2022] POST /identity/v3/services => generated 269 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 11:50:10.831665 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec98350-6571-409e-91a0-6b8c4bb7b31a None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:10.831860 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec98350-6571-409e-91a0-6b8c4bb7b31a None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:10.832139 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec98350-6571-409e-91a0-6b8c4bb7b31a None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:10.833467 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 380/762] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:50:10.839518 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf4a10-2950-4b76-81d4-b07b0e96a373 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:10.839870 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf4a10-2950-4b76-81d4-b07b0e96a373 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:10.840235 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf4a10-2950-4b76-81d4-b07b0e96a373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:10.858038 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-1edf4a10-2950-4b76-81d4-b07b0e96a373 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:50:10.859244 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-1edf4a10-2950-4b76-81d4-b07b0e96a373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:50:10.876638 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:10.932053 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 383/763] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:50:10 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 11:50:11.255336 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec98350-6571-409e-91a0-6b8c4bb7b31a None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:11.354520 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec98350-6571-409e-91a0-6b8c4bb7b31a None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:11.387448 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bee60e-a03f-43fb-ad9f-83f0f488d079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:11.388064 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bee60e-a03f-43fb-ad9f-83f0f488d079 None admin] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:11.388339 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bee60e-a03f-43fb-ad9f-83f0f488d079 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:11.388605 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bee60e-a03f-43fb-ad9f-83f0f488d079 None admin] PATH_INFO: `/v3/services` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:11.389240 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bee60e-a03f-43fb-ad9f-83f0f488d079 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:11.390594 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bee60e-a03f-43fb-ad9f-83f0f488d079 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:11.408020 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 381/764] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 21 11:50:11 2022] POST /identity/v3/services => generated 251 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 11:50:12.976634 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4562c2a-650c-4962-a771-445fc107f502 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:12.977495 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4562c2a-650c-4962-a771-445fc107f502 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:12.977768 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4562c2a-650c-4962-a771-445fc107f502 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:12.979107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 384/765] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:50:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:50:12.984312 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a260192-e014-4652-9d0c-ae9e8b14572a None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:12.984741 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a260192-e014-4652-9d0c-ae9e8b14572a None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:12.984874 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a260192-e014-4652-9d0c-ae9e8b14572a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:13.002972 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-7a260192-e014-4652-9d0c-ae9e8b14572a None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:50:13.004159 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-7a260192-e014-4652-9d0c-ae9e8b14572a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:50:13.017580 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:13.077603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 382/766] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:50:12 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 11:50:13.403831 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4562c2a-650c-4962-a771-445fc107f502 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:13.501530 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4562c2a-650c-4962-a771-445fc107f502 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:13.533920 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710f8d2-fb22-4419-a2a7-1e63b0af7b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:13.534535 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710f8d2-fb22-4419-a2a7-1e63b0af7b9b None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:13.534808 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710f8d2-fb22-4419-a2a7-1e63b0af7b9b None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:13.535074 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710f8d2-fb22-4419-a2a7-1e63b0af7b9b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:13.535644 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e710f8d2-fb22-4419-a2a7-1e63b0af7b9b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:13.537582 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e710f8d2-fb22-4419-a2a7-1e63b0af7b9b None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:13.546336 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-e710f8d2-fb22-4419-a2a7-1e63b0af7b9b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 11:50:13.546336 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:13.546336 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 11:50:13.546336 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 11:50:13.546336 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 11:50:13.546336 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 11:50:13.546336 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 11:50:13.546336 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:50:13.546336 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 11:50:13.546336 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:50:13.546336 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 11:50:13.546336 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:50:13.546336 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:13.546336 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:50:13.546336 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:50:13.546336 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:50:13.547398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:50:13.547398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:50:13.547398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:50:13.547398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:50:13.547398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:50:13.547398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:50:13.547398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:50:13.547398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 11:50:13.547398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 11:50:13.547398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 11:50:13.547398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 11:50:13.547398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:50:13.547398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:50:13.547398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:50:13.547398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:50:13.547398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:50:13.547398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:50:13.548348 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:50:13.548348 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:50:13.548348 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:50:13.548348 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:50:13.548348 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:50:13.548348 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:50:13.548348 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:50:13.548348 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:50:13.548348 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:50:13.548348 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:50:13.548348 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 11:50:13.548348 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:50:13.548348 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 11:50:13.548348 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:50:13.548348 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 385/767] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Sep 21 11:50:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:50:13.553271 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a260192-e014-4652-9d0c-ae9e8b14572a None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:13.651224 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a260192-e014-4652-9d0c-ae9e8b14572a None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:13.683891 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959877d-6359-4ac6-9c22-e4baf7a69aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:13.684426 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959877d-6359-4ac6-9c22-e4baf7a69aa5 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:13.684704 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959877d-6359-4ac6-9c22-e4baf7a69aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:13.684973 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959877d-6359-4ac6-9c22-e4baf7a69aa5 None admin] PATH_INFO: `/v3/services` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:13.685601 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959877d-6359-4ac6-9c22-e4baf7a69aa5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:13.685900 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959877d-6359-4ac6-9c22-e4baf7a69aa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:13.687263 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959877d-6359-4ac6-9c22-e4baf7a69aa5 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:13.691757 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 383/768] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 21 11:50:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:50:13.697958 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710f8d2-fb22-4419-a2a7-1e63b0af7b9b None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:13.714375 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:13.774979 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cd75b-5801-4b8b-9368-d4959244a6c0 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:13.775264 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cd75b-5801-4b8b-9368-d4959244a6c0 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:13.775534 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cd75b-5801-4b8b-9368-d4959244a6c0 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:13.776903 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 384/769] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 11:50:13.781763 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe332cc-ce3e-4d1c-8635-3e6de052ec3c None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:13.782045 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe332cc-ce3e-4d1c-8635-3e6de052ec3c None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:13.782316 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe332cc-ce3e-4d1c-8635-3e6de052ec3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:13.797570 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710f8d2-fb22-4419-a2a7-1e63b0af7b9b None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:13.800159 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-3fe332cc-ce3e-4d1c-8635-3e6de052ec3c None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:50:13.801327 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-3fe332cc-ce3e-4d1c-8635-3e6de052ec3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:50:13.804087 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:13.831844 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ef1eb-2179-4d44-93cd-68a666d6d6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:13.832472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ef1eb-2179-4d44-93cd-68a666d6d6e0 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:13.832745 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ef1eb-2179-4d44-93cd-68a666d6d6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:13.833011 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ef1eb-2179-4d44-93cd-68a666d6d6e0 None admin] PATH_INFO: `/v3/services` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:13.833624 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ef1eb-2179-4d44-93cd-68a666d6d6e0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:13.834482 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ef1eb-2179-4d44-93cd-68a666d6d6e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:13.835833 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ef1eb-2179-4d44-93cd-68a666d6d6e0 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:13.840632 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 386/770] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 21 11:50:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:50:13.846364 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ef1eb-2179-4d44-93cd-68a666d6d6e0 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:13.874010 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 385/771] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:50:13 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 11:50:13.922029 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:13.942360 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ef1eb-2179-4d44-93cd-68a666d6d6e0 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:13.975192 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a1453-2b5d-4f1c-9bb0-636e83282ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:13.975783 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a1453-2b5d-4f1c-9bb0-636e83282ddb None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:13.976081 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a1453-2b5d-4f1c-9bb0-636e83282ddb None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:13.976348 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a1453-2b5d-4f1c-9bb0-636e83282ddb None admin] PATH_INFO: `/v3/endpoints` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:13.977025 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a1453-2b5d-4f1c-9bb0-636e83282ddb None admin] RBAC: Adding query filter params (interface=public, service_id=4bcbc9378a2b4984a76bf294c6f2c02d, region_id=RegionOne) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:13.977551 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a1453-2b5d-4f1c-9bb0-636e83282ddb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:13.978665 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a1453-2b5d-4f1c-9bb0-636e83282ddb None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:13.985621 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 387/772] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Sep 21 11:50:13 2022] GET /identity/v3/endpoints?service_id=4bcbc9378a2b4984a76bf294c6f2c02d&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:50:13.991908 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe332cc-ce3e-4d1c-8635-3e6de052ec3c None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:14.090162 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe332cc-ce3e-4d1c-8635-3e6de052ec3c None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:14.124401 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f338ce4-4fdf-43b5-86db-a72c2fd4fe3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:14.124986 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f338ce4-4fdf-43b5-86db-a72c2fd4fe3e None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:14.125257 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f338ce4-4fdf-43b5-86db-a72c2fd4fe3e None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:14.125524 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f338ce4-4fdf-43b5-86db-a72c2fd4fe3e None admin] PATH_INFO: `/v3/services` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:14.126114 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f338ce4-4fdf-43b5-86db-a72c2fd4fe3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:14.127467 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f338ce4-4fdf-43b5-86db-a72c2fd4fe3e None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:14.133880 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 386/773] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 21 11:50:13 2022] GET /identity/v3/services => generated 1498 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 11:50:14.197793 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a1453-2b5d-4f1c-9bb0-636e83282ddb None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:14.424707 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a1453-2b5d-4f1c-9bb0-636e83282ddb None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:14.457703 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110d14c-18e9-4a59-b4e8-2e26811db206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:14.458238 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110d14c-18e9-4a59-b4e8-2e26811db206 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:14.458510 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110d14c-18e9-4a59-b4e8-2e26811db206 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:14.458794 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110d14c-18e9-4a59-b4e8-2e26811db206 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:14.459353 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110d14c-18e9-4a59-b4e8-2e26811db206 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:14.460731 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110d14c-18e9-4a59-b4e8-2e26811db206 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:14.469220 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-9110d14c-18e9-4a59-b4e8-2e26811db206 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 11:50:14.469220 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:14.469220 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 11:50:14.469220 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 11:50:14.469220 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 11:50:14.469220 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 11:50:14.469220 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 11:50:14.469220 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:50:14.469220 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 11:50:14.469220 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:50:14.469220 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 11:50:14.469220 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:50:14.469220 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:14.469220 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:50:14.469220 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:50:14.469220 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:50:14.469220 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:50:14.470319 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:50:14.470319 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:50:14.470319 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:50:14.470319 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:50:14.470319 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:50:14.470319 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:50:14.470319 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 11:50:14.470319 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 11:50:14.470319 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 11:50:14.470319 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 11:50:14.470319 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:50:14.470319 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:50:14.470319 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:50:14.470319 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:50:14.470319 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:50:14.470319 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:50:14.471186 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:50:14.471186 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:50:14.471186 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:50:14.471186 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:50:14.471186 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:50:14.471186 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:50:14.471186 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:50:14.471186 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:50:14.471186 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:50:14.471186 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:50:14.471186 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 11:50:14.471186 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:50:14.471186 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 11:50:14.471186 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:50:14.471186 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 388/774] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 11:50:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 11:50:14.476787 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f338ce4-4fdf-43b5-86db-a72c2fd4fe3e None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:14.481510 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:14.581145 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f338ce4-4fdf-43b5-86db-a72c2fd4fe3e None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:14.617329 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e63145-60c6-421f-b20d-0a71cada64af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:14.617926 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e63145-60c6-421f-b20d-0a71cada64af None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:14.618284 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e63145-60c6-421f-b20d-0a71cada64af None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:14.618587 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e63145-60c6-421f-b20d-0a71cada64af None admin] PATH_INFO: `/v3/services` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:14.619209 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e63145-60c6-421f-b20d-0a71cada64af None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:14.619570 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e63145-60c6-421f-b20d-0a71cada64af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:14.620961 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e63145-60c6-421f-b20d-0a71cada64af None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:14.625783 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 387/775] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 11:50:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:50:14.631537 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110d14c-18e9-4a59-b4e8-2e26811db206 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:14.640717 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:14.731975 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110d14c-18e9-4a59-b4e8-2e26811db206 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:14.764316 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474617d9-7000-4d53-8705-050c67928037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:14.764931 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474617d9-7000-4d53-8705-050c67928037 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:14.765200 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474617d9-7000-4d53-8705-050c67928037 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:14.765461 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474617d9-7000-4d53-8705-050c67928037 None admin] PATH_INFO: `/v3/services` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:14.766072 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474617d9-7000-4d53-8705-050c67928037 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:14.766362 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474617d9-7000-4d53-8705-050c67928037 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:14.767698 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474617d9-7000-4d53-8705-050c67928037 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:14.772778 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 389/776] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 11:50:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:50:14.778761 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e63145-60c6-421f-b20d-0a71cada64af None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:14.843028 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:14.876596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e63145-60c6-421f-b20d-0a71cada64af None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:14.910146 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f3b3f-7f14-4a5a-8ee7-ce1067c2c6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:14.910739 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f3b3f-7f14-4a5a-8ee7-ce1067c2c6ec None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:14.911011 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f3b3f-7f14-4a5a-8ee7-ce1067c2c6ec None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:14.911276 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f3b3f-7f14-4a5a-8ee7-ce1067c2c6ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:14.912614 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f3b3f-7f14-4a5a-8ee7-ce1067c2c6ec None admin] RBAC: Adding query filter params (interface=public, service_id=766bca5f4bde4fc896a0dfbd610149f2, region_id=RegionOne) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:14.912917 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f3b3f-7f14-4a5a-8ee7-ce1067c2c6ec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:14.914534 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f3b3f-7f14-4a5a-8ee7-ce1067c2c6ec None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:14.919439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 388/777] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Sep 21 11:50:14 2022] GET /identity/v3/endpoints?service_id=766bca5f4bde4fc896a0dfbd610149f2&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:50:14.925077 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474617d9-7000-4d53-8705-050c67928037 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:14.994127 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:15.025684 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474617d9-7000-4d53-8705-050c67928037 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:15.059708 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4092a6-2e20-4375-a1bc-32213f950bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:15.060328 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4092a6-2e20-4375-a1bc-32213f950bc9 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:15.060605 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4092a6-2e20-4375-a1bc-32213f950bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:15.060875 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4092a6-2e20-4375-a1bc-32213f950bc9 None admin] PATH_INFO: `/v3/services` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:15.061468 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4092a6-2e20-4375-a1bc-32213f950bc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:15.062818 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4092a6-2e20-4375-a1bc-32213f950bc9 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:15.068591 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 390/778] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 21 11:50:14 2022] GET /identity/v3/services => generated 1498 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 11:50:16.531893 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5979e70-230a-4162-893a-6c59962d7d82 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:16.532499 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5979e70-230a-4162-893a-6c59962d7d82 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:16.532499 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5979e70-230a-4162-893a-6c59962d7d82 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:16.533750 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 389/779] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:50:16.539790 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff32ca-96fc-40cd-935f-0e7b76421e55 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:16.540243 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff32ca-96fc-40cd-935f-0e7b76421e55 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:16.540351 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff32ca-96fc-40cd-935f-0e7b76421e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:16.557826 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-dfff32ca-96fc-40cd-935f-0e7b76421e55 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:50:16.558984 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-dfff32ca-96fc-40cd-935f-0e7b76421e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:50:16.627178 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 391/780] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:50:16 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 11:50:16.946092 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5979e70-230a-4162-893a-6c59962d7d82 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:17.048506 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5979e70-230a-4162-893a-6c59962d7d82 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:17.077899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:17.083422 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37bc2c4-67f0-4967-84dd-6bc023aadf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:17.084072 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37bc2c4-67f0-4967-84dd-6bc023aadf43 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:17.084345 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37bc2c4-67f0-4967-84dd-6bc023aadf43 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:17.084607 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37bc2c4-67f0-4967-84dd-6bc023aadf43 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:17.085179 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37bc2c4-67f0-4967-84dd-6bc023aadf43 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:17.086526 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37bc2c4-67f0-4967-84dd-6bc023aadf43 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:17.095247 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-a37bc2c4-67f0-4967-84dd-6bc023aadf43 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 11:50:17.095247 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:17.095247 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 11:50:17.095247 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 11:50:17.095247 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 11:50:17.095247 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 11:50:17.095247 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 11:50:17.095247 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:50:17.095247 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 11:50:17.095247 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:50:17.095247 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 11:50:17.095247 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:50:17.095247 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:17.095247 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:50:17.095247 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:50:17.095247 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:50:17.096548 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:50:17.096548 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:50:17.096548 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:50:17.096548 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:50:17.096548 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:50:17.096548 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:50:17.096548 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:50:17.096548 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 11:50:17.096548 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 11:50:17.096548 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 11:50:17.096548 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 11:50:17.096548 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:50:17.096548 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:50:17.096548 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:50:17.096548 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:50:17.096548 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:50:17.096548 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:50:17.097500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:50:17.097500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:50:17.097500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:50:17.097500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:50:17.097500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:50:17.097500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:50:17.097500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:50:17.097500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:50:17.097500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:50:17.097500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:50:17.097500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 11:50:17.097500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:50:17.097500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 11:50:17.097500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:50:17.097500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 390/781] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Sep 21 11:50:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:50:17.102373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff32ca-96fc-40cd-935f-0e7b76421e55 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:17.163313 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:17.201054 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff32ca-96fc-40cd-935f-0e7b76421e55 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:17.233643 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9e1be-b840-42ab-8a2a-92cb9bceba82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:17.234236 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9e1be-b840-42ab-8a2a-92cb9bceba82 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:17.234508 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9e1be-b840-42ab-8a2a-92cb9bceba82 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:17.234773 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9e1be-b840-42ab-8a2a-92cb9bceba82 None admin] PATH_INFO: `/v3/services` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:17.235390 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9e1be-b840-42ab-8a2a-92cb9bceba82 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:17.235684 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9e1be-b840-42ab-8a2a-92cb9bceba82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:17.237078 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9e1be-b840-42ab-8a2a-92cb9bceba82 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:17.242128 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 392/782] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 21 11:50:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:50:17.247765 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37bc2c4-67f0-4967-84dd-6bc023aadf43 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:17.343899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37bc2c4-67f0-4967-84dd-6bc023aadf43 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:17.377395 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228a3ea-89b7-4096-b406-6c3325bb1057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:17.377983 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228a3ea-89b7-4096-b406-6c3325bb1057 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:17.378254 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228a3ea-89b7-4096-b406-6c3325bb1057 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:17.378518 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228a3ea-89b7-4096-b406-6c3325bb1057 None admin] PATH_INFO: `/v3/services` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:17.379132 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228a3ea-89b7-4096-b406-6c3325bb1057 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:17.379428 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228a3ea-89b7-4096-b406-6c3325bb1057 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:17.380838 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228a3ea-89b7-4096-b406-6c3325bb1057 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:17.385434 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 391/783] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 21 11:50:17 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:50:17.391032 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9e1be-b840-42ab-8a2a-92cb9bceba82 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:17.450778 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c126e3-f727-486f-a9f6-b5dba86af92c None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:17.451127 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c126e3-f727-486f-a9f6-b5dba86af92c None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:17.451332 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c126e3-f727-486f-a9f6-b5dba86af92c None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:17.452808 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 392/784] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 11:50:17.457509 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bcae09-8ca7-47e3-833c-43937185531a None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:17.457788 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bcae09-8ca7-47e3-833c-43937185531a None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:17.458061 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bcae09-8ca7-47e3-833c-43937185531a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:17.476936 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-d6bcae09-8ca7-47e3-833c-43937185531a None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:50:17.477763 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-d6bcae09-8ca7-47e3-833c-43937185531a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:50:17.488130 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9e1be-b840-42ab-8a2a-92cb9bceba82 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:17.514219 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:17.522201 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b41258-f26b-4df1-939f-01b8042df7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:17.522786 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b41258-f26b-4df1-939f-01b8042df7d5 None admin] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:17.523052 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b41258-f26b-4df1-939f-01b8042df7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:17.523311 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b41258-f26b-4df1-939f-01b8042df7d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:17.523968 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b41258-f26b-4df1-939f-01b8042df7d5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:17.525337 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b41258-f26b-4df1-939f-01b8042df7d5 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:17.533391 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:17.544511 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 393/785] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 11:50:17 2022] POST /identity/v3/endpoints => generated 347 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 11:50:17.557303 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 393/786] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:50:17 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 11:50:17.890302 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b41258-f26b-4df1-939f-01b8042df7d5 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:17.987640 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b41258-f26b-4df1-939f-01b8042df7d5 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:18.019282 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d7078-ff5c-465f-b3a9-11e5c13ba299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:18.019901 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d7078-ff5c-465f-b3a9-11e5c13ba299 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:18.020208 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d7078-ff5c-465f-b3a9-11e5c13ba299 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:18.020479 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d7078-ff5c-465f-b3a9-11e5c13ba299 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:18.021549 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d7078-ff5c-465f-b3a9-11e5c13ba299 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:18.022887 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d7078-ff5c-465f-b3a9-11e5c13ba299 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:18.031474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-029d7078-ff5c-465f-b3a9-11e5c13ba299 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 11:50:18.031474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:18.031474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 11:50:18.031474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 11:50:18.031474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 11:50:18.031474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 11:50:18.031474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 11:50:18.031474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:50:18.031474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 11:50:18.031474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:50:18.031474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 11:50:18.031474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:50:18.031474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:18.031474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:50:18.031474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:50:18.031474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:50:18.031474 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:50:18.032669 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:50:18.032669 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:50:18.032669 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:50:18.032669 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:50:18.032669 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:50:18.032669 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:50:18.032669 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 11:50:18.032669 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 11:50:18.032669 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 11:50:18.032669 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 11:50:18.032669 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:50:18.032669 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:50:18.032669 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:50:18.032669 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:50:18.032669 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:50:18.032669 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:50:18.033521 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:50:18.033521 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:50:18.033521 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:50:18.033521 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:50:18.033521 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:50:18.033521 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:50:18.033521 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:50:18.033521 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:50:18.033521 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:50:18.033521 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:50:18.033521 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 11:50:18.033521 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:50:18.033521 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 11:50:18.033521 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:50:18.033521 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 394/787] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 11:50:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:50:18.039242 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bcae09-8ca7-47e3-833c-43937185531a None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:18.137256 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bcae09-8ca7-47e3-833c-43937185531a None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:18.170861 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07923a06-fdf2-43e1-8faa-49ff054c75ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:18.171378 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07923a06-fdf2-43e1-8faa-49ff054c75ac None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:18.171645 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07923a06-fdf2-43e1-8faa-49ff054c75ac None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:18.171912 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07923a06-fdf2-43e1-8faa-49ff054c75ac None admin] PATH_INFO: `/v3/services` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:18.172550 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07923a06-fdf2-43e1-8faa-49ff054c75ac None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:18.172841 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07923a06-fdf2-43e1-8faa-49ff054c75ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:18.174179 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07923a06-fdf2-43e1-8faa-49ff054c75ac None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:18.178933 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 394/788] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 11:50:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:50:18.184360 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d7078-ff5c-465f-b3a9-11e5c13ba299 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:18.232687 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:18.284241 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d7078-ff5c-465f-b3a9-11e5c13ba299 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:18.317107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de524c3-d78a-4b3b-9764-ac9dac7f52c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:18.318206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de524c3-d78a-4b3b-9764-ac9dac7f52c3 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:18.318476 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de524c3-d78a-4b3b-9764-ac9dac7f52c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:18.318738 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de524c3-d78a-4b3b-9764-ac9dac7f52c3 None admin] PATH_INFO: `/v3/services` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:18.319351 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de524c3-d78a-4b3b-9764-ac9dac7f52c3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:18.319642 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de524c3-d78a-4b3b-9764-ac9dac7f52c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:18.321010 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de524c3-d78a-4b3b-9764-ac9dac7f52c3 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:18.325583 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 395/789] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 11:50:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:50:18.331169 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07923a06-fdf2-43e1-8faa-49ff054c75ac None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:18.385201 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:18.433786 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07923a06-fdf2-43e1-8faa-49ff054c75ac None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:18.466654 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5c385-36af-469b-8066-d5ef18429a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:18.467241 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5c385-36af-469b-8066-d5ef18429a68 None admin] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:18.467515 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5c385-36af-469b-8066-d5ef18429a68 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:18.467783 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5c385-36af-469b-8066-d5ef18429a68 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:18.468492 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5c385-36af-469b-8066-d5ef18429a68 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:18.469853 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5c385-36af-469b-8066-d5ef18429a68 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:18.488673 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 395/790] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 11:50:18 2022] POST /identity/v3/endpoints => generated 346 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 11:50:19.962391 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7745932-ff5d-4422-aafe-f09ee7691693 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:19.962955 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7745932-ff5d-4422-aafe-f09ee7691693 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:19.962955 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7745932-ff5d-4422-aafe-f09ee7691693 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:19.964272 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 396/791] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:50:19.969461 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee163549-4e13-46d7-9f42-3f66c2facb4b None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:19.969859 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee163549-4e13-46d7-9f42-3f66c2facb4b None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:19.969997 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee163549-4e13-46d7-9f42-3f66c2facb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:19.987547 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-ee163549-4e13-46d7-9f42-3f66c2facb4b None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:50:19.988743 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-ee163549-4e13-46d7-9f42-3f66c2facb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:50:20.062287 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 396/792] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:50:19 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 11:50:20.390638 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7745932-ff5d-4422-aafe-f09ee7691693 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:20.491876 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7745932-ff5d-4422-aafe-f09ee7691693 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:20.509016 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:20.531617 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645c12a-d929-4cdd-bf38-c229d463cd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:20.532268 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645c12a-d929-4cdd-bf38-c229d463cd49 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:20.532542 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645c12a-d929-4cdd-bf38-c229d463cd49 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:20.532806 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645c12a-d929-4cdd-bf38-c229d463cd49 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:20.533375 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645c12a-d929-4cdd-bf38-c229d463cd49 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:20.534720 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645c12a-d929-4cdd-bf38-c229d463cd49 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:20.543982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-9645c12a-d929-4cdd-bf38-c229d463cd49 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 11:50:20.543982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:20.543982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 11:50:20.543982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 11:50:20.543982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 11:50:20.543982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 11:50:20.543982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 11:50:20.543982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:50:20.543982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 11:50:20.543982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:50:20.543982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 11:50:20.543982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:50:20.543982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:20.543982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:50:20.543982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:50:20.543982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:50:20.543982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:50:20.545133 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:50:20.545133 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:50:20.545133 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:50:20.545133 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:50:20.545133 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:50:20.545133 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:50:20.545133 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 11:50:20.545133 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 11:50:20.545133 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 11:50:20.545133 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 11:50:20.545133 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:50:20.545133 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:50:20.545133 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:50:20.545133 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:50:20.545133 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:50:20.545133 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:50:20.545975 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:50:20.545975 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:50:20.545975 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:50:20.545975 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:50:20.545975 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:50:20.545975 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:50:20.545975 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:50:20.545975 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:50:20.545975 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:50:20.545975 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:50:20.545975 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 11:50:20.545975 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:50:20.545975 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 11:50:20.545975 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:50:20.545975 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 397/793] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:50:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:50:20.550970 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee163549-4e13-46d7-9f42-3f66c2facb4b None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:20.583796 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:20.653356 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee163549-4e13-46d7-9f42-3f66c2facb4b None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:20.687836 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd62eb-2231-4d4b-891e-3d82a1a0ba4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:20.688470 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd62eb-2231-4d4b-891e-3d82a1a0ba4c None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:20.688738 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd62eb-2231-4d4b-891e-3d82a1a0ba4c None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:20.688999 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd62eb-2231-4d4b-891e-3d82a1a0ba4c None admin] PATH_INFO: `/v3/services` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:20.689628 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd62eb-2231-4d4b-891e-3d82a1a0ba4c None admin] RBAC: Adding query filter params (name=compute) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:20.689922 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd62eb-2231-4d4b-891e-3d82a1a0ba4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:20.691279 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd62eb-2231-4d4b-891e-3d82a1a0ba4c None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:20.697526 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 397/794] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 21 11:50:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:50:20.703841 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645c12a-d929-4cdd-bf38-c229d463cd49 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:20.805921 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645c12a-d929-4cdd-bf38-c229d463cd49 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:20.838153 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3acfc81-8d98-47c8-88f1-c6548e24c632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:20.838747 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acfc81-8d98-47c8-88f1-c6548e24c632 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:20.839020 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acfc81-8d98-47c8-88f1-c6548e24c632 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:20.839288 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acfc81-8d98-47c8-88f1-c6548e24c632 None admin] PATH_INFO: `/v3/services` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:20.839903 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3acfc81-8d98-47c8-88f1-c6548e24c632 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:20.840229 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3acfc81-8d98-47c8-88f1-c6548e24c632 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:20.841582 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3acfc81-8d98-47c8-88f1-c6548e24c632 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:20.845823 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 398/795] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 21 11:50:20 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:50:20.931073 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fd013-1ae8-45d1-a074-0d5893295ae9 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:20.931266 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fd013-1ae8-45d1-a074-0d5893295ae9 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:20.931517 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fd013-1ae8-45d1-a074-0d5893295ae9 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:20.932918 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 398/796] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:50:20.938969 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3eed1-5830-40b1-8eaf-a081d19709c9 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:20.939271 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3eed1-5830-40b1-8eaf-a081d19709c9 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:20.939604 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3eed1-5830-40b1-8eaf-a081d19709c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:20.959495 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-acb3eed1-5830-40b1-8eaf-a081d19709c9 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:50:20.960732 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-acb3eed1-5830-40b1-8eaf-a081d19709c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:50:20.996916 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:21.035016 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 399/797] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:50:20 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 11:50:21.366987 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fd013-1ae8-45d1-a074-0d5893295ae9 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:21.459376 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:21.466257 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fd013-1ae8-45d1-a074-0d5893295ae9 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:21.499252 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9a153-c450-4159-a694-f0b8247dbac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:21.499836 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9a153-c450-4159-a694-f0b8247dbac6 None admin] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:21.500146 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9a153-c450-4159-a694-f0b8247dbac6 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:21.500411 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9a153-c450-4159-a694-f0b8247dbac6 None admin] PATH_INFO: `/v3/projects` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:21.501039 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9a153-c450-4159-a694-f0b8247dbac6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:21.502450 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9a153-c450-4159-a694-f0b8247dbac6 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:21.505038 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: WARNING keystone.server.flask.common [None req-acf9a153-c450-4159-a694-f0b8247dbac6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 21 11:50:21.522376 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.sql.core [None req-acf9a153-c450-4159-a694-f0b8247dbac6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 21 11:50:21.522376 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 21 11:50:21.522376 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [parameters: {'id': '8333903b54324229b21b6fdf82c4b7db', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 21 11:50:21.522376 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88124) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 21 11:50:21.539577 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-acf9a153-c450-4159-a694-f0b8247dbac6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8333903b54324229b21b6fdf82c4b7db.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8333903b54324229b21b6fdf82c4b7db. Sep 21 11:50:21.539577 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:21.539577 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 21 11:50:21.539577 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 21 11:50:21.539577 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 21 11:50:21.539577 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 21 11:50:21.539577 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 21 11:50:21.539577 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application result = self._query(query) Sep 21 11:50:21.539577 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 21 11:50:21.539577 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application conn.query(q) Sep 21 11:50:21.539577 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 21 11:50:21.539577 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 21 11:50:21.539577 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 21 11:50:21.540572 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application result.read() Sep 21 11:50:21.540572 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 21 11:50:21.540572 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 21 11:50:21.540572 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 21 11:50:21.540572 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 21 11:50:21.540572 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 21 11:50:21.540572 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 21 11:50:21.540572 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 21 11:50:21.540572 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 21 11:50:21.540572 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 21 11:50:21.540572 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:50:21.540572 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 21 11:50:21.540572 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:50:21.540572 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:21.540572 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 21 11:50:21.540572 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 21 11:50:21.540572 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 21 11:50:21.540572 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 21 11:50:21.541549 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 21 11:50:21.541549 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application next(self.gen) Sep 21 11:50:21.541549 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 21 11:50:21.541549 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application yield resource Sep 21 11:50:21.541549 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 21 11:50:21.541549 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application next(self.gen) Sep 21 11:50:21.541549 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 21 11:50:21.541549 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self.session.rollback() Sep 21 11:50:21.541549 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 21 11:50:21.541549 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self.force_reraise() Sep 21 11:50:21.541549 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 21 11:50:21.541549 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise self.value Sep 21 11:50:21.541549 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 21 11:50:21.541549 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 21 11:50:21.541549 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 21 11:50:21.541549 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application session.commit() Sep 21 11:50:21.541549 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 21 11:50:21.542508 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 21 11:50:21.542508 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 21 11:50:21.542508 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self._prepare_impl() Sep 21 11:50:21.542508 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 21 11:50:21.542508 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self.session.flush() Sep 21 11:50:21.542508 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 21 11:50:21.542508 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self._flush(objects) Sep 21 11:50:21.542508 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 21 11:50:21.542508 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 21 11:50:21.542508 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 21 11:50:21.542508 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application compat.raise_( Sep 21 11:50:21.542508 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 21 11:50:21.542508 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception Sep 21 11:50:21.542508 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 21 11:50:21.542508 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application flush_context.execute() Sep 21 11:50:21.542508 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 21 11:50:21.542508 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rec.execute(self) Sep 21 11:50:21.543477 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 21 11:50:21.543477 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 21 11:50:21.543477 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 21 11:50:21.543477 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 21 11:50:21.543477 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 21 11:50:21.543477 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 21 11:50:21.543477 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 21 11:50:21.543477 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 21 11:50:21.543477 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 21 11:50:21.543477 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 21 11:50:21.543477 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 21 11:50:21.543477 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 21 11:50:21.543477 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 21 11:50:21.543477 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 21 11:50:21.543477 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 21 11:50:21.544397 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 21 11:50:21.544397 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 21 11:50:21.544397 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception Sep 21 11:50:21.544397 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 21 11:50:21.544397 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 21 11:50:21.544397 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 21 11:50:21.544397 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 21 11:50:21.544397 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 21 11:50:21.544397 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application result = self._query(query) Sep 21 11:50:21.544397 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 21 11:50:21.544397 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application conn.query(q) Sep 21 11:50:21.544397 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 21 11:50:21.544397 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 21 11:50:21.544397 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 21 11:50:21.544397 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application result.read() Sep 21 11:50:21.544397 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 21 11:50:21.544397 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 21 11:50:21.545296 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 21 11:50:21.545296 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 21 11:50:21.545296 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 21 11:50:21.545296 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 21 11:50:21.545296 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 21 11:50:21.545296 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 21 11:50:21.545296 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 21 11:50:21.545296 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 21 11:50:21.545296 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [parameters: {'id': '8333903b54324229b21b6fdf82c4b7db', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 21 11:50:21.545296 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 21 11:50:21.545296 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:50:21.545296 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 11:50:21.545296 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:50:21.545296 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:21.545296 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 21 11:50:21.546102 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 21 11:50:21.546102 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 21 11:50:21.546102 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 21 11:50:21.546102 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 21 11:50:21.546102 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:50:21.546102 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 11:50:21.546102 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:50:21.546102 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:21.546102 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:50:21.546102 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:50:21.546102 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:50:21.546102 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:50:21.546102 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:50:21.546102 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:50:21.546102 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:50:21.546102 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:50:21.546102 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:50:21.547026 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:50:21.547026 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 21 11:50:21.547026 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 21 11:50:21.547026 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:50:21.547026 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:50:21.547026 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 21 11:50:21.547026 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 21 11:50:21.547026 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8333903b54324229b21b6fdf82c4b7db. Sep 21 11:50:21.547026 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:50:21.547026 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 399/798] 10.222.0.27 () {60 vars in 1140 bytes} [Wed Sep 21 11:50:21 2022] POST /identity/v3/projects => generated 262 bytes in 174 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:50:21.547588 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3eed1-5830-40b1-8eaf-a081d19709c9 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:21.643267 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3eed1-5830-40b1-8eaf-a081d19709c9 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:21.676150 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f07ac-ad09-4126-b24d-e24b87cc5758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:21.677319 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f07ac-ad09-4126-b24d-e24b87cc5758 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:21.677589 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f07ac-ad09-4126-b24d-e24b87cc5758 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:21.677851 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f07ac-ad09-4126-b24d-e24b87cc5758 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:21.684187 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f07ac-ad09-4126-b24d-e24b87cc5758 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:21.685633 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f07ac-ad09-4126-b24d-e24b87cc5758 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:21.696856 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-e73f07ac-ad09-4126-b24d-e24b87cc5758 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:50:21.696856 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:21.696856 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:50:21.696856 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:50:21.696856 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:50:21.696856 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:50:21.696856 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:50:21.696856 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:50:21.696856 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:50:21.696856 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:50:21.696856 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:50:21.696856 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:50:21.696856 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 11:50:21.696856 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 11:50:21.696856 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 11:50:21.698122 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 11:50:21.698122 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:50:21.698122 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:50:21.698122 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:50:21.698122 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:50:21.698122 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:50:21.698122 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:50:21.698122 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:50:21.698122 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:50:21.698122 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:50:21.698122 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:50:21.698122 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:50:21.698122 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:50:21.698122 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:50:21.698122 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:50:21.698122 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:50:21.698122 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:50:21.699372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 11:50:21.699372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 11:50:21.699372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 11:50:21.699372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 11:50:21.699372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 11:50:21.699372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 11:50:21.699372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:50:21.699372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:50:21.699372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 400/799] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:50:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:50:21.704006 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9a153-c450-4159-a694-f0b8247dbac6 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:21.800642 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9a153-c450-4159-a694-f0b8247dbac6 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:21.835485 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae217e2-62f7-4c32-b700-e6386b59044b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:21.836106 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae217e2-62f7-4c32-b700-e6386b59044b None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:21.836385 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae217e2-62f7-4c32-b700-e6386b59044b None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:21.836655 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae217e2-62f7-4c32-b700-e6386b59044b None admin] PATH_INFO: `/v3/projects` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:21.837311 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae217e2-62f7-4c32-b700-e6386b59044b None admin] RBAC: Adding query filter params (name=service) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:21.837611 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae217e2-62f7-4c32-b700-e6386b59044b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:21.839228 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae217e2-62f7-4c32-b700-e6386b59044b None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:21.860424 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 400/800] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 21 11:50:21 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:50:23.255902 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f817e-da45-4491-8d1c-230ec9e5a719 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:23.256499 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f817e-da45-4491-8d1c-230ec9e5a719 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:23.256499 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f817e-da45-4491-8d1c-230ec9e5a719 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:23.257771 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 401/801] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:50:23.263272 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab9c9d-db58-46b7-a05d-b842876bebb4 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:23.263674 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab9c9d-db58-46b7-a05d-b842876bebb4 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:23.263949 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab9c9d-db58-46b7-a05d-b842876bebb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:23.282418 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-27ab9c9d-db58-46b7-a05d-b842876bebb4 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:50:23.283886 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-27ab9c9d-db58-46b7-a05d-b842876bebb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:50:23.291245 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:23.350970 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 401/802] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:50:23 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 11:50:23.678551 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f817e-da45-4491-8d1c-230ec9e5a719 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:23.709273 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:23.778767 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f817e-da45-4491-8d1c-230ec9e5a719 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:23.811505 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4f28f-308e-46e1-abcd-e2898b849046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:23.812142 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4f28f-308e-46e1-abcd-e2898b849046 None admin] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:23.812421 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4f28f-308e-46e1-abcd-e2898b849046 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:23.812689 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4f28f-308e-46e1-abcd-e2898b849046 None admin] PATH_INFO: `/v3/services` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:23.813490 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd4f28f-308e-46e1-abcd-e2898b849046 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:23.814749 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd4f28f-308e-46e1-abcd-e2898b849046 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:23.830239 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 402/803] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 21 11:50:23 2022] POST /identity/v3/services => generated 242 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 11:50:24.298567 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d73dae-03fe-445f-b547-7e7292a3e558 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:24.299105 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d73dae-03fe-445f-b547-7e7292a3e558 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:24.299105 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d73dae-03fe-445f-b547-7e7292a3e558 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:24.300475 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 402/804] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:50:24.305827 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96d95d-51d5-49d2-a814-1080376d1414 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:24.306347 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96d95d-51d5-49d2-a814-1080376d1414 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:24.306347 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96d95d-51d5-49d2-a814-1080376d1414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:24.324606 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-df96d95d-51d5-49d2-a814-1080376d1414 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:50:24.325768 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-df96d95d-51d5-49d2-a814-1080376d1414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:50:24.396304 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 403/805] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:50:24 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 11:50:24.721313 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d73dae-03fe-445f-b547-7e7292a3e558 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:24.825905 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d73dae-03fe-445f-b547-7e7292a3e558 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:24.861136 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a0de0-0922-4193-9684-7f80cf891342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:24.861665 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a0de0-0922-4193-9684-7f80cf891342 None admin] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:24.861940 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a0de0-0922-4193-9684-7f80cf891342 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:24.862212 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a0de0-0922-4193-9684-7f80cf891342 None admin] PATH_INFO: `/v3/users` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:24.862850 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a0de0-0922-4193-9684-7f80cf891342 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:24.864926 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a0de0-0922-4193-9684-7f80cf891342 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:24.881357 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.sql.core [None req-c42a0de0-0922-4193-9684-7f80cf891342 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 21 11:50:24.881357 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 21 11:50:24.881357 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [parameters: {'user_id': 'f6fc8231f2274b728f211182ca85034f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 21 11:50:24.881357 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88124) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 21 11:50:24.889095 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-c42a0de0-0922-4193-9684-7f80cf891342 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 21 11:50:24.889095 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:24.889095 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 21 11:50:24.889095 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 21 11:50:24.889095 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 21 11:50:24.889095 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 21 11:50:24.889095 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 21 11:50:24.889095 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application result = self._query(query) Sep 21 11:50:24.889095 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 21 11:50:24.889095 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application conn.query(q) Sep 21 11:50:24.889095 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 21 11:50:24.889095 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 21 11:50:24.889095 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 21 11:50:24.889095 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application result.read() Sep 21 11:50:24.889095 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 21 11:50:24.890289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 21 11:50:24.890289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 21 11:50:24.890289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 21 11:50:24.890289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 21 11:50:24.890289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 21 11:50:24.890289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 21 11:50:24.890289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 21 11:50:24.890289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 21 11:50:24.890289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:50:24.890289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 21 11:50:24.890289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:50:24.890289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:24.890289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 21 11:50:24.890289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 21 11:50:24.890289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 21 11:50:24.890289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 21 11:50:24.890289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 21 11:50:24.890289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application next(self.gen) Sep 21 11:50:24.891421 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 21 11:50:24.891421 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application yield resource Sep 21 11:50:24.891421 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 21 11:50:24.891421 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application next(self.gen) Sep 21 11:50:24.891421 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 21 11:50:24.891421 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self.session.rollback() Sep 21 11:50:24.891421 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 21 11:50:24.891421 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self.force_reraise() Sep 21 11:50:24.891421 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 21 11:50:24.891421 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise self.value Sep 21 11:50:24.891421 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 21 11:50:24.891421 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 21 11:50:24.891421 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 21 11:50:24.891421 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application session.commit() Sep 21 11:50:24.891421 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 21 11:50:24.891421 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 21 11:50:24.891421 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 21 11:50:24.892460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self._prepare_impl() Sep 21 11:50:24.892460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 21 11:50:24.892460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self.session.flush() Sep 21 11:50:24.892460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 21 11:50:24.892460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self._flush(objects) Sep 21 11:50:24.892460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 21 11:50:24.892460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 21 11:50:24.892460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 21 11:50:24.892460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application compat.raise_( Sep 21 11:50:24.892460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 21 11:50:24.892460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception Sep 21 11:50:24.892460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 21 11:50:24.892460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application flush_context.execute() Sep 21 11:50:24.892460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 21 11:50:24.892460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rec.execute(self) Sep 21 11:50:24.892460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 21 11:50:24.892460 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 21 11:50:24.893382 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 21 11:50:24.893382 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 21 11:50:24.893382 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 21 11:50:24.893382 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 21 11:50:24.893382 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 21 11:50:24.893382 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 21 11:50:24.893382 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 21 11:50:24.893382 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 21 11:50:24.893382 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 21 11:50:24.893382 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 21 11:50:24.893382 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 21 11:50:24.893382 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 21 11:50:24.893382 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 21 11:50:24.893382 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 21 11:50:24.893382 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 21 11:50:24.893382 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception Sep 21 11:50:24.894244 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 21 11:50:24.894244 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 21 11:50:24.894244 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 21 11:50:24.894244 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 21 11:50:24.894244 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 21 11:50:24.894244 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application result = self._query(query) Sep 21 11:50:24.894244 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 21 11:50:24.894244 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application conn.query(q) Sep 21 11:50:24.894244 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 21 11:50:24.894244 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 21 11:50:24.894244 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 21 11:50:24.894244 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application result.read() Sep 21 11:50:24.894244 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 21 11:50:24.894244 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 21 11:50:24.894244 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 21 11:50:24.894244 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 21 11:50:24.895084 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 21 11:50:24.895084 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 21 11:50:24.895084 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 21 11:50:24.895084 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 21 11:50:24.895084 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 21 11:50:24.895084 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 21 11:50:24.895084 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f6fc8231f2274b728f211182ca85034f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 21 11:50:24.895084 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 21 11:50:24.895084 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:50:24.895084 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 11:50:24.895084 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:50:24.895084 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:24.895084 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:50:24.895084 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:50:24.895084 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:50:24.900506 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:50:24.900506 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:50:24.900506 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:50:24.900506 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:50:24.900506 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:50:24.900506 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:50:24.900506 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:50:24.900506 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 21 11:50:24.900506 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 21 11:50:24.900506 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:50:24.900506 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:50:24.900506 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 11:50:24.900506 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:50:24.900506 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 11:50:24.900506 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:50:24.900506 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 21 11:50:24.900506 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 21 11:50:24.902588 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 21 11:50:24.902588 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 21 11:50:24.902588 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 21 11:50:24.902588 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 21 11:50:24.902588 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 21 11:50:24.902588 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:50:24.902588 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 403/806] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Sep 21 11:50:24 2022] POST /identity/v3/users => generated 160 bytes in 170 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:50:24.903443 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96d95d-51d5-49d2-a814-1080376d1414 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:24.915771 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:25.006440 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96d95d-51d5-49d2-a814-1080376d1414 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:25.041972 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2fed6-9a46-4b42-b752-5572e607bc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:25.042611 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2fed6-9a46-4b42-b752-5572e607bc79 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:25.042894 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2fed6-9a46-4b42-b752-5572e607bc79 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:25.043158 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2fed6-9a46-4b42-b752-5572e607bc79 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:25.050397 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2fed6-9a46-4b42-b752-5572e607bc79 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:25.052438 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2fed6-9a46-4b42-b752-5572e607bc79 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:25.064012 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-fae2fed6-9a46-4b42-b752-5572e607bc79 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 11:50:25.064012 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:25.064012 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:50:25.064012 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:50:25.064012 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:50:25.064012 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:50:25.064012 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:50:25.064012 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:50:25.064012 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:50:25.064012 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:50:25.064012 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:50:25.064012 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:50:25.064012 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 11:50:25.064012 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 11:50:25.064012 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 11:50:25.064012 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 11:50:25.065066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:50:25.065066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:50:25.065066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 11:50:25.065066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:50:25.065066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 11:50:25.065066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:50:25.065066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:50:25.065066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:50:25.065066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:50:25.065066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:50:25.065066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:50:25.065066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:50:25.065066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:50:25.065066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:50:25.065066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:50:25.065066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:50:25.065066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:50:25.065066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:50:25.066107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:50:25.066107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:50:25.066107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 11:50:25.066107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 11:50:25.066107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 11:50:25.066107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 11:50:25.066107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 11:50:25.066107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 11:50:25.066107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 11:50:25.066107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:50:25.066107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 404/807] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:50:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:50:25.071154 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a0de0-0922-4193-9684-7f80cf891342 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:25.076032 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:25.179099 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a0de0-0922-4193-9684-7f80cf891342 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:25.212604 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c7eb5-d64d-4d3c-8661-682c6f6eecc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:25.213198 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c7eb5-d64d-4d3c-8661-682c6f6eecc8 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:25.213475 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c7eb5-d64d-4d3c-8661-682c6f6eecc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:25.213748 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c7eb5-d64d-4d3c-8661-682c6f6eecc8 None admin] PATH_INFO: `/v3/users` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:25.214436 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c7eb5-d64d-4d3c-8661-682c6f6eecc8 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:25.214736 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c7eb5-d64d-4d3c-8661-682c6f6eecc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:25.216379 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c7eb5-d64d-4d3c-8661-682c6f6eecc8 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:25.253859 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 404/808] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 11:50:25 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:50:26.204944 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d9288-7f6b-45ff-8382-f3d3bffa4853 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:26.205449 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d9288-7f6b-45ff-8382-f3d3bffa4853 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:26.205449 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d9288-7f6b-45ff-8382-f3d3bffa4853 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:26.206737 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 405/809] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:50:26.212899 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f89d4-42d0-45d9-afbf-b907592c81a2 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:26.213395 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f89d4-42d0-45d9-afbf-b907592c81a2 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:26.213780 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f89d4-42d0-45d9-afbf-b907592c81a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:26.232320 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-9e6f89d4-42d0-45d9-afbf-b907592c81a2 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:50:26.233789 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-9e6f89d4-42d0-45d9-afbf-b907592c81a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:50:26.289834 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:26.300313 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 405/810] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:50:26 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 11:50:26.618535 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d9288-7f6b-45ff-8382-f3d3bffa4853 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:26.700269 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:26.725200 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d9288-7f6b-45ff-8382-f3d3bffa4853 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:26.757682 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154d8fc-c4da-41ef-bc75-aa115f9207f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:26.758287 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154d8fc-c4da-41ef-bc75-aa115f9207f2 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:26.758557 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154d8fc-c4da-41ef-bc75-aa115f9207f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:26.758818 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154d8fc-c4da-41ef-bc75-aa115f9207f2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:26.759386 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154d8fc-c4da-41ef-bc75-aa115f9207f2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:26.760766 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154d8fc-c4da-41ef-bc75-aa115f9207f2 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:26.773568 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-f154d8fc-c4da-41ef-bc75-aa115f9207f2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 11:50:26.773568 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:26.773568 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 11:50:26.773568 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 11:50:26.773568 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 11:50:26.773568 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 11:50:26.773568 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 11:50:26.773568 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:50:26.773568 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 11:50:26.773568 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:50:26.773568 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 11:50:26.773568 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:50:26.773568 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:26.773568 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:50:26.773568 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:50:26.773568 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:50:26.773568 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:50:26.774741 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:50:26.774741 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:50:26.774741 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:50:26.774741 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:50:26.774741 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:50:26.774741 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:50:26.774741 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 11:50:26.774741 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 11:50:26.774741 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 11:50:26.774741 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 11:50:26.774741 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:50:26.774741 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:50:26.774741 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:50:26.774741 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:50:26.774741 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:50:26.774741 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:50:26.775799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:50:26.775799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:50:26.775799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:50:26.775799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:50:26.775799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:50:26.775799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:50:26.775799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:50:26.775799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:50:26.775799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:50:26.775799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:50:26.775799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 11:50:26.775799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:50:26.775799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 11:50:26.775799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:50:26.775799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 406/811] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:50:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:50:26.780913 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f89d4-42d0-45d9-afbf-b907592c81a2 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:26.883324 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f89d4-42d0-45d9-afbf-b907592c81a2 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:26.917419 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fbc0f-fe9e-47be-b4fe-ce10ababcf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:26.918001 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fbc0f-fe9e-47be-b4fe-ce10ababcf8f None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:26.918269 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fbc0f-fe9e-47be-b4fe-ce10ababcf8f None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:26.918530 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fbc0f-fe9e-47be-b4fe-ce10ababcf8f None admin] PATH_INFO: `/v3/services` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:26.919142 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fbc0f-fe9e-47be-b4fe-ce10ababcf8f None admin] RBAC: Adding query filter params (name=compute) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:26.919432 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fbc0f-fe9e-47be-b4fe-ce10ababcf8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:26.920811 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fbc0f-fe9e-47be-b4fe-ce10ababcf8f None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:26.925529 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 406/812] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 21 11:50:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:50:26.931565 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154d8fc-c4da-41ef-bc75-aa115f9207f2 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:27.031944 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154d8fc-c4da-41ef-bc75-aa115f9207f2 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:27.065571 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcddeb6-0bc6-4c5d-b696-82727cc0e482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:27.066161 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcddeb6-0bc6-4c5d-b696-82727cc0e482 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:27.066433 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcddeb6-0bc6-4c5d-b696-82727cc0e482 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:27.066698 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcddeb6-0bc6-4c5d-b696-82727cc0e482 None admin] PATH_INFO: `/v3/services` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:27.067342 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcddeb6-0bc6-4c5d-b696-82727cc0e482 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:27.067638 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcddeb6-0bc6-4c5d-b696-82727cc0e482 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:27.069110 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcddeb6-0bc6-4c5d-b696-82727cc0e482 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:27.075927 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 407/813] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 21 11:50:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:50:27.082359 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fbc0f-fe9e-47be-b4fe-ce10ababcf8f None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:27.139059 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:27.182684 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fbc0f-fe9e-47be-b4fe-ce10ababcf8f None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:27.216674 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7fed6-90c2-488f-bcd9-f11504461ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:27.217290 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7fed6-90c2-488f-bcd9-f11504461ab7 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:27.217572 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7fed6-90c2-488f-bcd9-f11504461ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:27.217766 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7fed6-90c2-488f-bcd9-f11504461ab7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:27.218969 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b7fed6-90c2-488f-bcd9-f11504461ab7 None admin] RBAC: Adding query filter params (interface=public, service_id=5ddb0c9c672f4447a4bbfbfe5bda9e55, region_id=RegionOne) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:27.218969 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b7fed6-90c2-488f-bcd9-f11504461ab7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:27.220103 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b7fed6-90c2-488f-bcd9-f11504461ab7 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:27.225232 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 407/814] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Sep 21 11:50:27 2022] GET /identity/v3/endpoints?service_id=5ddb0c9c672f4447a4bbfbfe5bda9e55&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:50:27.231608 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcddeb6-0bc6-4c5d-b696-82727cc0e482 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:27.235360 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:27.329483 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcddeb6-0bc6-4c5d-b696-82727cc0e482 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:27.361601 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2b82b-4acd-4bfe-a7ce-34bbc1506e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:27.362191 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2b82b-4acd-4bfe-a7ce-34bbc1506e6e None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:27.362460 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2b82b-4acd-4bfe-a7ce-34bbc1506e6e None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:27.362932 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2b82b-4acd-4bfe-a7ce-34bbc1506e6e None admin] PATH_INFO: `/v3/services` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:27.363522 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2b82b-4acd-4bfe-a7ce-34bbc1506e6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:27.364905 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2b82b-4acd-4bfe-a7ce-34bbc1506e6e None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:27.371562 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 408/815] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 21 11:50:27 2022] GET /identity/v3/services => generated 1728 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 11:50:29.736630 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470457e-4f8f-419a-9e5f-6dfba2469e3b None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:29.737147 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470457e-4f8f-419a-9e5f-6dfba2469e3b None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:29.737147 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470457e-4f8f-419a-9e5f-6dfba2469e3b None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:29.738468 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 408/816] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 11:50:29.744124 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29bb43-5e25-40c9-ba7f-26c2288a885d None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:29.744520 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29bb43-5e25-40c9-ba7f-26c2288a885d None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:29.744657 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29bb43-5e25-40c9-ba7f-26c2288a885d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:29.762703 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-ce29bb43-5e25-40c9-ba7f-26c2288a885d None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:50:29.763855 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-ce29bb43-5e25-40c9-ba7f-26c2288a885d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:50:29.821788 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:29.827324 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 409/817] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:50:29 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 11:50:30.143514 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470457e-4f8f-419a-9e5f-6dfba2469e3b None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:30.241501 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470457e-4f8f-419a-9e5f-6dfba2469e3b None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:30.261966 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:30.276505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643cb9a3-0679-4361-9494-2cb8e8b17933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:30.277113 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cb9a3-0679-4361-9494-2cb8e8b17933 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:30.277387 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cb9a3-0679-4361-9494-2cb8e8b17933 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:30.277654 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cb9a3-0679-4361-9494-2cb8e8b17933 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:30.278222 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643cb9a3-0679-4361-9494-2cb8e8b17933 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:30.279573 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643cb9a3-0679-4361-9494-2cb8e8b17933 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:30.288333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-643cb9a3-0679-4361-9494-2cb8e8b17933 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 11:50:30.288333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:30.288333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 11:50:30.288333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 11:50:30.288333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 11:50:30.288333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 11:50:30.288333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 11:50:30.288333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:50:30.288333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 11:50:30.288333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:50:30.288333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 11:50:30.288333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:50:30.288333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:50:30.288333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:50:30.288333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:50:30.288333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:50:30.288333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:50:30.289510 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:50:30.289510 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:50:30.289510 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:50:30.289510 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:50:30.289510 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:50:30.289510 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:50:30.289510 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 11:50:30.289510 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 11:50:30.289510 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 11:50:30.289510 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 11:50:30.289510 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:50:30.289510 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:50:30.289510 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:50:30.289510 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:50:30.289510 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:50:30.289510 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:50:30.290343 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:50:30.290343 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:50:30.290343 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:50:30.290343 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:50:30.290343 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:50:30.290343 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:50:30.290343 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:50:30.290343 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:50:30.290343 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:50:30.290343 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:50:30.290343 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 11:50:30.290343 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:50:30.290343 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 11:50:30.290343 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:50:30.290343 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 409/818] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:50:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:50:30.295434 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29bb43-5e25-40c9-ba7f-26c2288a885d None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:30.391447 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29bb43-5e25-40c9-ba7f-26c2288a885d None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:30.424978 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288c253-6440-4e73-99bc-0e457a6b691b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:30.425502 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288c253-6440-4e73-99bc-0e457a6b691b None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:30.425777 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288c253-6440-4e73-99bc-0e457a6b691b None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:30.426047 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288c253-6440-4e73-99bc-0e457a6b691b None admin] PATH_INFO: `/v3/services` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:30.426662 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288c253-6440-4e73-99bc-0e457a6b691b None admin] RBAC: Adding query filter params (name=compute) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:30.426960 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288c253-6440-4e73-99bc-0e457a6b691b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:30.428326 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288c253-6440-4e73-99bc-0e457a6b691b None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:30.432993 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 410/819] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 21 11:50:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:50:30.438626 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643cb9a3-0679-4361-9494-2cb8e8b17933 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:30.535547 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643cb9a3-0679-4361-9494-2cb8e8b17933 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:30.568423 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7566b7c-a7d3-499d-aaf1-6cc473f0f63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:30.568999 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7566b7c-a7d3-499d-aaf1-6cc473f0f63d None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:30.569270 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7566b7c-a7d3-499d-aaf1-6cc473f0f63d None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:30.569535 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7566b7c-a7d3-499d-aaf1-6cc473f0f63d None admin] PATH_INFO: `/v3/services` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:30.570142 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7566b7c-a7d3-499d-aaf1-6cc473f0f63d None admin] RBAC: Adding query filter params (type=compute) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:50:30.570435 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7566b7c-a7d3-499d-aaf1-6cc473f0f63d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:30.571779 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7566b7c-a7d3-499d-aaf1-6cc473f0f63d None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:30.576702 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 410/820] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 21 11:50:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:50:30.582635 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288c253-6440-4e73-99bc-0e457a6b691b None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:50:30.641480 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:30.679651 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288c253-6440-4e73-99bc-0e457a6b691b None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:50:30.712143 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033fe13-f3ab-429f-ac60-1e80dc736f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:50:30.712735 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033fe13-f3ab-429f-ac60-1e80dc736f5a None admin] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:50:30.713005 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033fe13-f3ab-429f-ac60-1e80dc736f5a None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:50:30.713268 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033fe13-f3ab-429f-ac60-1e80dc736f5a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:50:30.713923 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033fe13-f3ab-429f-ac60-1e80dc736f5a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:50:30.715254 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033fe13-f3ab-429f-ac60-1e80dc736f5a None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:50:30.733970 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 411/821] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 11:50:30 2022] POST /identity/v3/endpoints => generated 334 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 11:50:40.574129 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=76 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:50:40.729881 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=40,keystone:INSERT=1 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:33.899782 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331e2e1-312f-4d9a-bbba-15e75f45558a None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:33.899782 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331e2e1-312f-4d9a-bbba-15e75f45558a None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:33.899782 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331e2e1-312f-4d9a-bbba-15e75f45558a None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:33.899782 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 411/822] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 11:51:33.905355 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15386e8-f9d0-4168-9978-40c1b94de125 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:33.905811 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15386e8-f9d0-4168-9978-40c1b94de125 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:33.905916 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15386e8-f9d0-4168-9978-40c1b94de125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:33.929834 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-f15386e8-f9d0-4168-9978-40c1b94de125 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:51:33.931602 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-f15386e8-f9d0-4168-9978-40c1b94de125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:51:34.020967 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 412/823] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:51:33 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 11:51:34.348679 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331e2e1-312f-4d9a-bbba-15e75f45558a None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:34.468858 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331e2e1-312f-4d9a-bbba-15e75f45558a None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:34.516930 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac212c1-5421-4421-a5b0-8255583d0deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:34.520691 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac212c1-5421-4421-a5b0-8255583d0deb None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:34.521012 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac212c1-5421-4421-a5b0-8255583d0deb None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:34.521287 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac212c1-5421-4421-a5b0-8255583d0deb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:34.533734 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac212c1-5421-4421-a5b0-8255583d0deb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:34.535427 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac212c1-5421-4421-a5b0-8255583d0deb None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:34.560333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-eac212c1-5421-4421-a5b0-8255583d0deb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:51:34.560333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:51:34.560333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:51:34.560333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:51:34.560333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:51:34.560333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:51:34.560333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:51:34.560333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:51:34.560333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:51:34.560333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:51:34.560333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:51:34.560333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:51:34.560333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:51:34.560333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:51:34.560333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:51:34.560333 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:51:34.561783 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:51:34.561783 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:51:34.561783 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:51:34.561783 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:51:34.561783 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:51:34.561783 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:51:34.561783 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:51:34.561783 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:51:34.561783 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:51:34.561783 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:51:34.561783 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:51:34.561783 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:51:34.561783 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:51:34.561783 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:51:34.561783 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:51:34.561783 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:51:34.561783 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:51:34.563557 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:51:34.563557 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:51:34.563557 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:51:34.563557 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 412/824] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:51:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:51:34.568636 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15386e8-f9d0-4168-9978-40c1b94de125 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:34.692785 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15386e8-f9d0-4168-9978-40c1b94de125 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:34.726238 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:34.738801 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba046ff-bc91-4510-a104-0c40110f05b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:34.739324 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba046ff-bc91-4510-a104-0c40110f05b0 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:34.739617 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba046ff-bc91-4510-a104-0c40110f05b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:34.739898 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba046ff-bc91-4510-a104-0c40110f05b0 None admin] PATH_INFO: `/v3/domains` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:34.740655 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba046ff-bc91-4510-a104-0c40110f05b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:51:34.741011 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba046ff-bc91-4510-a104-0c40110f05b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:34.742755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba046ff-bc91-4510-a104-0c40110f05b0 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:34.759589 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 413/825] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:51:34.766332 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac212c1-5421-4421-a5b0-8255583d0deb None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:34.835058 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:34.899686 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac212c1-5421-4421-a5b0-8255583d0deb None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:34.942441 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aaf94a-68c4-4feb-8812-99ebe09abf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:34.943249 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aaf94a-68c4-4feb-8812-99ebe09abf02 None admin] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:34.943350 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aaf94a-68c4-4feb-8812-99ebe09abf02 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:34.943613 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aaf94a-68c4-4feb-8812-99ebe09abf02 None admin] PATH_INFO: `/v3/users` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:34.944310 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aaf94a-68c4-4feb-8812-99ebe09abf02 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:34.945788 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aaf94a-68c4-4feb-8812-99ebe09abf02 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:34.980018 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 413/826] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 21 11:51:34 2022] POST /identity/v3/users => generated 251 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 11:51:37.470120 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4645b97-9165-476c-873e-800ce886c28c None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:37.470742 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4645b97-9165-476c-873e-800ce886c28c None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:37.470742 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4645b97-9165-476c-873e-800ce886c28c None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:37.471951 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 414/827] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:51:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:51:37.477195 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e32afb-ae76-414d-909d-97392b467feb None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:37.477653 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e32afb-ae76-414d-909d-97392b467feb None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:37.477740 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e32afb-ae76-414d-909d-97392b467feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:37.497123 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-23e32afb-ae76-414d-909d-97392b467feb None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:51:37.498405 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-23e32afb-ae76-414d-909d-97392b467feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:51:37.577317 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 414/828] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:51:37 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 11:51:37.914531 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4645b97-9165-476c-873e-800ce886c28c None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:38.039370 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4645b97-9165-476c-873e-800ce886c28c None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:38.074685 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2125d-b869-4fdb-9ee6-db3c95acc1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:38.075306 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2125d-b869-4fdb-9ee6-db3c95acc1fc None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:38.075576 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2125d-b869-4fdb-9ee6-db3c95acc1fc None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:38.075843 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2125d-b869-4fdb-9ee6-db3c95acc1fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:38.088604 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd2125d-b869-4fdb-9ee6-db3c95acc1fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:51:38.094279 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-acd2125d-b869-4fdb-9ee6-db3c95acc1fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 11:51:38.094279 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:51:38.094279 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:51:38.094279 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:51:38.094279 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:51:38.094279 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:51:38.094279 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:51:38.094279 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:51:38.094279 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:51:38.094279 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:51:38.094279 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:51:38.094279 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:51:38.094279 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:51:38.094279 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:51:38.094279 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:51:38.094279 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:51:38.095378 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:51:38.095378 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:51:38.095378 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:51:38.095378 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:51:38.095378 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:51:38.095378 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:51:38.095378 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:51:38.095378 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:51:38.095378 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:51:38.095378 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:51:38.095378 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:51:38.095378 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:51:38.095378 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:51:38.095378 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:51:38.095378 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:51:38.095378 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:51:38.096317 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:51:38.096317 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:51:38.096317 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:51:38.096317 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:51:38.096317 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:51:38.096317 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:51:38.096317 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:51:38.096317 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:51:38.096317 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:51:38.096317 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:51:38.096317 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 11:51:38.096317 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:51:38.096317 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 415/829] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 11:51:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:51:38.101938 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e32afb-ae76-414d-909d-97392b467feb None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:38.144593 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:38.211896 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e32afb-ae76-414d-909d-97392b467feb None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:38.246445 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544a0df-91c4-423e-ba41-de4d149db7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:38.247047 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544a0df-91c4-423e-ba41-de4d149db7e8 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:38.247304 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544a0df-91c4-423e-ba41-de4d149db7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:38.247580 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544a0df-91c4-423e-ba41-de4d149db7e8 None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:38.248279 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544a0df-91c4-423e-ba41-de4d149db7e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:51:38.248592 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544a0df-91c4-423e-ba41-de4d149db7e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:38.249957 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544a0df-91c4-423e-ba41-de4d149db7e8 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:38.259847 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 415/830] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 11:51:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:51:38.264738 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2125d-b869-4fdb-9ee6-db3c95acc1fc None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:38.322615 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:38.385750 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2125d-b869-4fdb-9ee6-db3c95acc1fc None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:38.423107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564b1ab-3b34-4bdd-9a3d-d8df0daac248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:38.423753 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564b1ab-3b34-4bdd-9a3d-d8df0daac248 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:38.424057 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564b1ab-3b34-4bdd-9a3d-d8df0daac248 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:38.424329 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564b1ab-3b34-4bdd-9a3d-d8df0daac248 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:38.435390 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564b1ab-3b34-4bdd-9a3d-d8df0daac248 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:38.436893 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564b1ab-3b34-4bdd-9a3d-d8df0daac248 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:38.451611 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-e564b1ab-3b34-4bdd-9a3d-d8df0daac248 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:51:38.451611 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:51:38.451611 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:51:38.451611 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:51:38.451611 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:51:38.451611 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:51:38.451611 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:51:38.451611 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:51:38.451611 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:51:38.451611 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:51:38.451611 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:51:38.451611 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:51:38.451611 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:51:38.451611 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:51:38.451611 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:51:38.451611 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:51:38.452845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:51:38.452845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:51:38.452845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:51:38.452845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:51:38.452845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:51:38.452845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:51:38.452845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:51:38.452845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:51:38.452845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:51:38.452845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:51:38.452845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:51:38.452845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:51:38.452845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:51:38.452845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:51:38.452845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:51:38.452845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:51:38.452845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:51:38.454322 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:51:38.454322 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:51:38.454322 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:51:38.454322 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 416/831] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:51:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 11:51:38.459888 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544a0df-91c4-423e-ba41-de4d149db7e8 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:38.568020 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:38.571366 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544a0df-91c4-423e-ba41-de4d149db7e8 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:38.609241 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304238c-8452-4b28-871f-ac27c52f4680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:38.609965 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304238c-8452-4b28-871f-ac27c52f4680 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:38.610546 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304238c-8452-4b28-871f-ac27c52f4680 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:38.610546 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304238c-8452-4b28-871f-ac27c52f4680 None admin] PATH_INFO: `/v3/domains` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:38.611013 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304238c-8452-4b28-871f-ac27c52f4680 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:51:38.611311 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304238c-8452-4b28-871f-ac27c52f4680 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:38.612700 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304238c-8452-4b28-871f-ac27c52f4680 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:38.626185 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 416/832] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:51:38.633285 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564b1ab-3b34-4bdd-9a3d-d8df0daac248 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:38.743411 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:38.748215 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564b1ab-3b34-4bdd-9a3d-d8df0daac248 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:38.785999 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83be278-8af6-4b1a-8342-8ab2b922a6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:38.787234 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83be278-8af6-4b1a-8342-8ab2b922a6b3 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:38.787750 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83be278-8af6-4b1a-8342-8ab2b922a6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:38.788214 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83be278-8af6-4b1a-8342-8ab2b922a6b3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:38.796811 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83be278-8af6-4b1a-8342-8ab2b922a6b3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:38.798694 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83be278-8af6-4b1a-8342-8ab2b922a6b3 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:38.809799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-a83be278-8af6-4b1a-8342-8ab2b922a6b3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 21 11:51:38.809799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:51:38.809799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:51:38.809799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:51:38.809799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:51:38.809799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:51:38.809799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:51:38.809799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:51:38.809799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:51:38.809799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:51:38.809799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:51:38.809799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:51:38.809799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 11:51:38.809799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 11:51:38.809799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 11:51:38.809799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 11:51:38.811016 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:51:38.811016 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:51:38.811016 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 11:51:38.811016 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:51:38.811016 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 11:51:38.811016 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:51:38.811016 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:51:38.811016 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:51:38.811016 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:51:38.811016 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:51:38.811016 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:51:38.811016 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:51:38.811016 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:51:38.811016 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:51:38.811016 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:51:38.811016 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:51:38.811016 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:51:38.811016 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:51:38.812182 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:51:38.812182 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:51:38.812182 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 11:51:38.812182 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 11:51:38.812182 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 11:51:38.812182 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 11:51:38.812182 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 11:51:38.812182 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 11:51:38.812182 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 21 11:51:38.812182 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:51:38.812182 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 417/833] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:51:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:51:38.817356 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304238c-8452-4b28-871f-ac27c52f4680 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:38.926820 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304238c-8452-4b28-871f-ac27c52f4680 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:38.966848 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f69c0a-47ba-41de-aa63-7afbe0eccf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:38.967439 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f69c0a-47ba-41de-aa63-7afbe0eccf45 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:38.967710 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f69c0a-47ba-41de-aa63-7afbe0eccf45 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:38.967974 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f69c0a-47ba-41de-aa63-7afbe0eccf45 None admin] PATH_INFO: `/v3/users` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:38.968937 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f69c0a-47ba-41de-aa63-7afbe0eccf45 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:51:38.969335 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f69c0a-47ba-41de-aa63-7afbe0eccf45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:38.971104 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f69c0a-47ba-41de-aa63-7afbe0eccf45 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:38.992423 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 417/834] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Sep 21 11:51:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:51:38.998045 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83be278-8af6-4b1a-8342-8ab2b922a6b3 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:39.108018 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83be278-8af6-4b1a-8342-8ab2b922a6b3 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:39.144281 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6cdb6d-bf81-4057-a930-d65a2ffe03a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:39.144872 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6cdb6d-bf81-4057-a930-d65a2ffe03a2 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:39.145146 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6cdb6d-bf81-4057-a930-d65a2ffe03a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:39.145411 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6cdb6d-bf81-4057-a930-d65a2ffe03a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:39.174240 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:39.217251 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6cdb6d-bf81-4057-a930-d65a2ffe03a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:39.218613 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6cdb6d-bf81-4057-a930-d65a2ffe03a2 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:39.338915 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 418/835] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:51:38 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 11:51:39.345662 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f69c0a-47ba-41de-aa63-7afbe0eccf45 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:39.367466 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:39.454667 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f69c0a-47ba-41de-aa63-7afbe0eccf45 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:39.492549 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ed042-f424-41a7-a084-6efe9d85d69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:39.493135 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ed042-f424-41a7-a084-6efe9d85d69c None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:39.493412 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ed042-f424-41a7-a084-6efe9d85d69c None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:39.493680 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ed042-f424-41a7-a084-6efe9d85d69c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:39.505383 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ed042-f424-41a7-a084-6efe9d85d69c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:39.506822 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ed042-f424-41a7-a084-6efe9d85d69c None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:39.522195 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-c11ed042-f424-41a7-a084-6efe9d85d69c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:51:39.522195 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:51:39.522195 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:51:39.522195 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:51:39.522195 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:51:39.522195 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:51:39.522195 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:51:39.522195 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:51:39.522195 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:51:39.522195 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:51:39.522195 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:51:39.522195 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:51:39.522195 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:51:39.522195 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:51:39.522195 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:51:39.522195 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:51:39.523269 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:51:39.523269 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:51:39.523269 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:51:39.523269 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:51:39.523269 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:51:39.523269 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:51:39.523269 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:51:39.523269 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:51:39.523269 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:51:39.523269 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:51:39.523269 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:51:39.523269 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:51:39.523269 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:51:39.523269 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:51:39.523269 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:51:39.523269 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:51:39.523269 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:51:39.524413 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:51:39.524413 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:51:39.524413 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:51:39.524413 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 418/836] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:51:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:51:39.529019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6cdb6d-bf81-4057-a930-d65a2ffe03a2 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:39.593500 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:39.641563 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6cdb6d-bf81-4057-a930-d65a2ffe03a2 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:39.681678 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb3911-86c5-4419-aa00-299f89e544dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:39.682281 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb3911-86c5-4419-aa00-299f89e544dc None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:39.682559 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb3911-86c5-4419-aa00-299f89e544dc None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:39.682823 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb3911-86c5-4419-aa00-299f89e544dc None admin] PATH_INFO: `/v3/domains` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:39.683539 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb3911-86c5-4419-aa00-299f89e544dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:51:39.683769 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb3911-86c5-4419-aa00-299f89e544dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:39.685121 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb3911-86c5-4419-aa00-299f89e544dc None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:39.697646 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 419/837] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:51:39.704462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ed042-f424-41a7-a084-6efe9d85d69c None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:39.784491 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:39.820682 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ed042-f424-41a7-a084-6efe9d85d69c None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:39.859326 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae09fe-6de9-4f96-b330-fcb0c2dfd6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:39.860020 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae09fe-6de9-4f96-b330-fcb0c2dfd6c4 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:39.860336 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae09fe-6de9-4f96-b330-fcb0c2dfd6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:39.860603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae09fe-6de9-4f96-b330-fcb0c2dfd6c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:39.867584 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae09fe-6de9-4f96-b330-fcb0c2dfd6c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:39.869052 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae09fe-6de9-4f96-b330-fcb0c2dfd6c4 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:39.881435 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-65ae09fe-6de9-4f96-b330-fcb0c2dfd6c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:51:39.881435 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:51:39.881435 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:51:39.881435 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:51:39.881435 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:51:39.881435 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:51:39.881435 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:51:39.881435 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:51:39.881435 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:51:39.881435 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:51:39.881435 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:51:39.881435 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:51:39.881435 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 11:51:39.881435 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 11:51:39.881435 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 11:51:39.882712 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 11:51:39.882712 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:51:39.882712 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:51:39.882712 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:51:39.882712 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:51:39.882712 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:51:39.882712 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:51:39.882712 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:51:39.882712 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:51:39.882712 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:51:39.882712 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:51:39.882712 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:51:39.882712 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:51:39.882712 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:51:39.882712 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:51:39.882712 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:51:39.882712 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:51:39.883835 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 11:51:39.883835 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 11:51:39.883835 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 11:51:39.883835 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 11:51:39.883835 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 11:51:39.883835 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 11:51:39.883835 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:51:39.883835 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:51:39.883835 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 419/838] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:51:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:51:39.890497 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb3911-86c5-4419-aa00-299f89e544dc None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:40.008824 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb3911-86c5-4419-aa00-299f89e544dc None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:40.030284 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:40.050546 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668bfd6-596f-4e5d-bbbc-838b469cc8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:40.051089 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668bfd6-596f-4e5d-bbbc-838b469cc8f9 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:40.051346 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668bfd6-596f-4e5d-bbbc-838b469cc8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:40.051700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668bfd6-596f-4e5d-bbbc-838b469cc8f9 None admin] PATH_INFO: `/v3/projects` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:40.052334 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668bfd6-596f-4e5d-bbbc-838b469cc8f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:51:40.052631 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668bfd6-596f-4e5d-bbbc-838b469cc8f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:40.054337 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668bfd6-596f-4e5d-bbbc-838b469cc8f9 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:40.067513 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 420/839] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 11:51:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:51:40.074199 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae09fe-6de9-4f96-b330-fcb0c2dfd6c4 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:40.190591 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae09fe-6de9-4f96-b330-fcb0c2dfd6c4 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:40.224546 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:40.230733 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e3d0f-80ec-4fe5-be5a-0fd6f9b351fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:40.231326 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e3d0f-80ec-4fe5-be5a-0fd6f9b351fc None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:40.231601 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e3d0f-80ec-4fe5-be5a-0fd6f9b351fc None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:40.231864 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e3d0f-80ec-4fe5-be5a-0fd6f9b351fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:40.232604 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e3d0f-80ec-4fe5-be5a-0fd6f9b351fc None admin] RBAC: Adding query filter params (role.id=1557d254ce394d9e8d83e9c55cc20445, scope.project.id=1fd87b195f7c46d2a0d621124acce331, user.id=c58b4f9b474c492984a08198cb7df0a0) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:51:40.232905 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e3d0f-80ec-4fe5-be5a-0fd6f9b351fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:40.234850 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e3d0f-80ec-4fe5-be5a-0fd6f9b351fc None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:40.242300 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 420/840] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 11:51:40 2022] GET /identity/v3/role_assignments?user.id=c58b4f9b474c492984a08198cb7df0a0&scope.project.id=1fd87b195f7c46d2a0d621124acce331&role.id=1557d254ce394d9e8d83e9c55cc20445 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:51:42.864186 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf7acb-887d-40b8-bbdf-671b3af36326 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:42.865869 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf7acb-887d-40b8-bbdf-671b3af36326 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:42.865869 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf7acb-887d-40b8-bbdf-671b3af36326 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:42.866199 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 421/841] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:51:42.872630 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbb22b-810b-436d-80f0-d7929c6924c7 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:42.873147 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbb22b-810b-436d-80f0-d7929c6924c7 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:42.873235 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbb22b-810b-436d-80f0-d7929c6924c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:42.897972 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-dedbb22b-810b-436d-80f0-d7929c6924c7 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:51:42.899301 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-dedbb22b-810b-436d-80f0-d7929c6924c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:51:42.984031 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 421/842] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:51:42 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 11:51:43.339365 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf7acb-887d-40b8-bbdf-671b3af36326 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:43.454652 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf7acb-887d-40b8-bbdf-671b3af36326 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:43.490477 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466e9db-7c9a-4b2c-8935-483b58331b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:43.491085 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466e9db-7c9a-4b2c-8935-483b58331b8e None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:43.491353 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466e9db-7c9a-4b2c-8935-483b58331b8e None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:43.491656 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466e9db-7c9a-4b2c-8935-483b58331b8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:43.502361 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c466e9db-7c9a-4b2c-8935-483b58331b8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:51:43.507422 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-c466e9db-7c9a-4b2c-8935-483b58331b8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 11:51:43.507422 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:51:43.507422 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:51:43.507422 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:51:43.507422 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:51:43.507422 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:51:43.507422 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:51:43.507422 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:51:43.507422 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:51:43.507422 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:51:43.507422 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:51:43.507422 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:51:43.507422 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:51:43.507422 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:51:43.507422 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:51:43.507422 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:51:43.508645 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:51:43.508645 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:51:43.508645 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:51:43.508645 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:51:43.508645 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:51:43.508645 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:51:43.508645 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:51:43.508645 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:51:43.508645 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:51:43.508645 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:51:43.508645 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:51:43.508645 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:51:43.508645 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:51:43.508645 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:51:43.508645 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:51:43.508645 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:51:43.510021 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:51:43.510021 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:51:43.510021 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:51:43.510021 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:51:43.510021 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:51:43.510021 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:51:43.510021 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:51:43.510021 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:51:43.510021 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:51:43.510021 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:51:43.510021 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 11:51:43.510021 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:51:43.510021 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 422/843] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 11:51:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:51:43.514719 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbb22b-810b-436d-80f0-d7929c6924c7 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:43.629895 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbb22b-810b-436d-80f0-d7929c6924c7 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:43.665168 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:43.680637 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b38781-deec-4c2c-97b0-00172e291560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:43.681461 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b38781-deec-4c2c-97b0-00172e291560 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:43.681799 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b38781-deec-4c2c-97b0-00172e291560 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:43.682136 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b38781-deec-4c2c-97b0-00172e291560 None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:43.682848 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b38781-deec-4c2c-97b0-00172e291560 None admin] RBAC: Adding query filter params (name=service) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:51:43.683199 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b38781-deec-4c2c-97b0-00172e291560 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:43.684795 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b38781-deec-4c2c-97b0-00172e291560 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:43.700954 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 422/844] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 11:51:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:51:43.702642 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466e9db-7c9a-4b2c-8935-483b58331b8e None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:43.751309 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:43.818283 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466e9db-7c9a-4b2c-8935-483b58331b8e None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:43.857877 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0e291-dbe3-470f-8da8-4ee48cb33a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:43.858718 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0e291-dbe3-470f-8da8-4ee48cb33a2e None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:43.859118 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0e291-dbe3-470f-8da8-4ee48cb33a2e None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:43.859439 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0e291-dbe3-470f-8da8-4ee48cb33a2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:43.871069 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0e291-dbe3-470f-8da8-4ee48cb33a2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:43.872543 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0e291-dbe3-470f-8da8-4ee48cb33a2e None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:43.889588 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-b5d0e291-dbe3-470f-8da8-4ee48cb33a2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:51:43.889588 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:51:43.889588 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:51:43.889588 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:51:43.889588 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:51:43.889588 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:51:43.889588 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:51:43.889588 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:51:43.889588 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:51:43.889588 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:51:43.889588 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:51:43.889588 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:51:43.889588 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:51:43.889588 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:51:43.889588 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:51:43.889588 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:51:43.891121 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:51:43.891121 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:51:43.891121 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:51:43.891121 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:51:43.891121 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:51:43.891121 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:51:43.891121 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:51:43.891121 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:51:43.891121 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:51:43.891121 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:51:43.891121 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:51:43.891121 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:51:43.891121 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:51:43.891121 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:51:43.891121 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:51:43.891121 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:51:43.891121 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:51:43.892107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:51:43.892107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:51:43.892107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:51:43.892107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 423/845] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:51:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:51:43.897788 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b38781-deec-4c2c-97b0-00172e291560 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:44.007953 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b38781-deec-4c2c-97b0-00172e291560 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:44.041516 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb737b5-7f4b-4669-bab5-7d7b72f054d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:44.042132 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb737b5-7f4b-4669-bab5-7d7b72f054d5 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:44.042384 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb737b5-7f4b-4669-bab5-7d7b72f054d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:44.042654 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb737b5-7f4b-4669-bab5-7d7b72f054d5 None admin] PATH_INFO: `/v3/domains` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:44.043314 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb737b5-7f4b-4669-bab5-7d7b72f054d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:51:44.043612 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb737b5-7f4b-4669-bab5-7d7b72f054d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:44.045002 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb737b5-7f4b-4669-bab5-7d7b72f054d5 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:44.057661 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 423/846] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:51:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:51:44.064761 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0e291-dbe3-470f-8da8-4ee48cb33a2e None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:44.157975 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:44.169154 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0e291-dbe3-470f-8da8-4ee48cb33a2e None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:44.204655 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8451a-c2a9-4ba4-9f8a-665ddc520de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:44.205366 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8451a-c2a9-4ba4-9f8a-665ddc520de8 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:44.205650 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8451a-c2a9-4ba4-9f8a-665ddc520de8 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:44.205948 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8451a-c2a9-4ba4-9f8a-665ddc520de8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:44.213494 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8451a-c2a9-4ba4-9f8a-665ddc520de8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:44.214916 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8451a-c2a9-4ba4-9f8a-665ddc520de8 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:44.226098 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-39c8451a-c2a9-4ba4-9f8a-665ddc520de8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 21 11:51:44.226098 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:51:44.226098 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:51:44.226098 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:51:44.226098 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:51:44.226098 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:51:44.226098 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:51:44.226098 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:51:44.226098 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:51:44.226098 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:51:44.226098 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:51:44.226098 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:51:44.226098 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 11:51:44.226098 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 11:51:44.226098 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 11:51:44.226098 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 11:51:44.227402 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:51:44.227402 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:51:44.227402 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 11:51:44.227402 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:51:44.227402 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 11:51:44.227402 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:51:44.227402 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:51:44.227402 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:51:44.227402 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:51:44.227402 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:51:44.227402 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:51:44.227402 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:51:44.227402 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:51:44.227402 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:51:44.227402 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:51:44.227402 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:51:44.227402 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:51:44.227402 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:51:44.228631 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:51:44.228631 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:51:44.228631 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 11:51:44.228631 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 11:51:44.228631 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 11:51:44.228631 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 11:51:44.228631 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 11:51:44.228631 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 11:51:44.228631 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 21 11:51:44.228631 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:51:44.228631 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 424/847] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:51:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:51:44.233123 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb737b5-7f4b-4669-bab5-7d7b72f054d5 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:44.286855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:44.350187 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb737b5-7f4b-4669-bab5-7d7b72f054d5 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:44.384326 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835790d-fe22-4c64-8e59-4f924614707d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:44.385220 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835790d-fe22-4c64-8e59-4f924614707d None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:44.385549 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835790d-fe22-4c64-8e59-4f924614707d None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:44.385823 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835790d-fe22-4c64-8e59-4f924614707d None admin] PATH_INFO: `/v3/users` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:44.386819 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1835790d-fe22-4c64-8e59-4f924614707d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:51:44.387145 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1835790d-fe22-4c64-8e59-4f924614707d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:44.388948 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1835790d-fe22-4c64-8e59-4f924614707d None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:44.410284 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 424/848] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Sep 21 11:51:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:51:44.416967 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8451a-c2a9-4ba4-9f8a-665ddc520de8 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:44.531082 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8451a-c2a9-4ba4-9f8a-665ddc520de8 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:44.568260 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7d269-b5b0-4e54-a68a-19208dc3465c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:44.568935 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7d269-b5b0-4e54-a68a-19208dc3465c None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:44.569228 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7d269-b5b0-4e54-a68a-19208dc3465c None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:44.569492 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7d269-b5b0-4e54-a68a-19208dc3465c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:44.582740 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7d269-b5b0-4e54-a68a-19208dc3465c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:44.584209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7d269-b5b0-4e54-a68a-19208dc3465c None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:44.600533 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-e9d7d269-b5b0-4e54-a68a-19208dc3465c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:51:44.600533 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:51:44.600533 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:51:44.600533 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:51:44.600533 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:51:44.600533 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:51:44.600533 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:51:44.600533 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:51:44.600533 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:51:44.600533 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:51:44.600533 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:51:44.600533 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:51:44.600533 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:51:44.600533 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:51:44.600533 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:51:44.600533 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:51:44.601761 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:51:44.601761 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:51:44.601761 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:51:44.601761 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:51:44.601761 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:51:44.601761 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:51:44.601761 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:51:44.601761 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:51:44.601761 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:51:44.601761 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:51:44.601761 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:51:44.601761 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:51:44.601761 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:51:44.601761 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:51:44.601761 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:51:44.601761 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:51:44.601761 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:51:44.602844 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:51:44.602844 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:51:44.602844 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:51:44.602844 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 425/849] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:51:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:51:44.607626 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835790d-fe22-4c64-8e59-4f924614707d None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:44.719711 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835790d-fe22-4c64-8e59-4f924614707d None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:44.722184 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:44.757144 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80555fc8-7646-444b-98ef-3d7acded0c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:44.757746 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80555fc8-7646-444b-98ef-3d7acded0c1e None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:44.758111 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80555fc8-7646-444b-98ef-3d7acded0c1e None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:44.758296 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80555fc8-7646-444b-98ef-3d7acded0c1e None admin] PATH_INFO: `/v3/domains` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:44.758953 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80555fc8-7646-444b-98ef-3d7acded0c1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:51:44.759220 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80555fc8-7646-444b-98ef-3d7acded0c1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:44.760613 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80555fc8-7646-444b-98ef-3d7acded0c1e None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:44.773544 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 425/850] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:51:44.779190 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7d269-b5b0-4e54-a68a-19208dc3465c None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:44.782170 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:44.887495 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7d269-b5b0-4e54-a68a-19208dc3465c None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:44.922166 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5903af2-843a-411b-a874-f8ed3c635d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:44.922762 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5903af2-843a-411b-a874-f8ed3c635d83 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:44.923034 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5903af2-843a-411b-a874-f8ed3c635d83 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:44.923301 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5903af2-843a-411b-a874-f8ed3c635d83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:44.930983 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5903af2-843a-411b-a874-f8ed3c635d83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:44.932519 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5903af2-843a-411b-a874-f8ed3c635d83 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:44.943766 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-b5903af2-843a-411b-a874-f8ed3c635d83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:51:44.943766 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:51:44.943766 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:51:44.943766 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:51:44.943766 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:51:44.943766 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:51:44.943766 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:51:44.943766 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:51:44.943766 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:51:44.943766 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:51:44.943766 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:51:44.943766 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:51:44.943766 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 11:51:44.943766 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 11:51:44.943766 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 11:51:44.944707 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 11:51:44.944707 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:51:44.944707 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:51:44.944707 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:51:44.944707 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:51:44.944707 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:51:44.944707 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:51:44.944707 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:51:44.944707 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:51:44.944707 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:51:44.944707 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:51:44.944707 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:51:44.944707 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:51:44.944707 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:51:44.944707 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:51:44.944707 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:51:44.944707 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:51:44.945666 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 11:51:44.945666 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 11:51:44.945666 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 11:51:44.945666 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 11:51:44.945666 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 11:51:44.945666 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 11:51:44.945666 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:51:44.945666 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:51:44.945666 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 426/851] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:51:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:51:44.951159 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80555fc8-7646-444b-98ef-3d7acded0c1e None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:45.072668 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80555fc8-7646-444b-98ef-3d7acded0c1e None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:45.112612 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908e248-c379-4f25-8fbb-95dc78d3b88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:45.113204 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908e248-c379-4f25-8fbb-95dc78d3b88f None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:45.113474 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908e248-c379-4f25-8fbb-95dc78d3b88f None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:45.113739 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908e248-c379-4f25-8fbb-95dc78d3b88f None admin] PATH_INFO: `/v3/projects` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:45.114552 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908e248-c379-4f25-8fbb-95dc78d3b88f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:51:45.114897 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908e248-c379-4f25-8fbb-95dc78d3b88f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:45.116384 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908e248-c379-4f25-8fbb-95dc78d3b88f None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:45.130711 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 426/852] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 11:51:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:51:45.136963 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5903af2-843a-411b-a874-f8ed3c635d83 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:45.217496 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:45.269167 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5903af2-843a-411b-a874-f8ed3c635d83 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:45.315195 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ff358-5784-4500-95c1-a72a6303260b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:45.315894 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ff358-5784-4500-95c1-a72a6303260b None admin] REQUEST_METHOD: `PUT` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:45.316210 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ff358-5784-4500-95c1-a72a6303260b None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:45.316506 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ff358-5784-4500-95c1-a72a6303260b None admin] PATH_INFO: `/v3/projects/1fd87b195f7c46d2a0d621124acce331/users/c58b4f9b474c492984a08198cb7df0a0/roles/1557d254ce394d9e8d83e9c55cc20445` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:45.334240 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ff358-5784-4500-95c1-a72a6303260b None admin] RBAC: Authorizing `identity:create_grant(project_id=1fd87b195f7c46d2a0d621124acce331, user_id=c58b4f9b474c492984a08198cb7df0a0, role_id=1557d254ce394d9e8d83e9c55cc20445)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:45.335322 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ff358-5784-4500-95c1-a72a6303260b None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:45.349007 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 427/853] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 11:51:45 2022] PUT /identity/v3/projects/1fd87b195f7c46d2a0d621124acce331/users/c58b4f9b474c492984a08198cb7df0a0/roles/1557d254ce394d9e8d83e9c55cc20445 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 11:51:48.301342 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad7f11-8ad1-472e-871f-3b92f4bca166 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:48.302044 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad7f11-8ad1-472e-871f-3b92f4bca166 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:48.302044 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad7f11-8ad1-472e-871f-3b92f4bca166 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:48.303194 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 427/854] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:51:48.309751 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24ccc2-c224-4793-a895-3ef8e02e1c9b None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:48.310214 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24ccc2-c224-4793-a895-3ef8e02e1c9b None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:48.310403 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24ccc2-c224-4793-a895-3ef8e02e1c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:48.333198 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-dd24ccc2-c224-4793-a895-3ef8e02e1c9b None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:51:48.335099 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-dd24ccc2-c224-4793-a895-3ef8e02e1c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:51:48.422816 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 428/855] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:51:48 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 11:51:48.756556 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad7f11-8ad1-472e-871f-3b92f4bca166 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:48.785849 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:48.879118 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad7f11-8ad1-472e-871f-3b92f4bca166 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:48.917013 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa432117-6881-4d45-bd39-0d0fdc2d2c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:48.917675 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa432117-6881-4d45-bd39-0d0fdc2d2c64 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:48.917952 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa432117-6881-4d45-bd39-0d0fdc2d2c64 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:48.918290 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa432117-6881-4d45-bd39-0d0fdc2d2c64 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:48.928743 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa432117-6881-4d45-bd39-0d0fdc2d2c64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:51:48.933738 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-aa432117-6881-4d45-bd39-0d0fdc2d2c64 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 11:51:48.933738 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:51:48.933738 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:51:48.933738 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:51:48.933738 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:51:48.933738 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:51:48.933738 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:51:48.933738 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:51:48.933738 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:51:48.933738 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:51:48.933738 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:51:48.933738 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:51:48.933738 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:51:48.933738 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:51:48.933738 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:51:48.933738 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:51:48.934839 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:51:48.934839 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:51:48.934839 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:51:48.934839 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:51:48.934839 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:51:48.934839 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:51:48.934839 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:51:48.934839 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:51:48.934839 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:51:48.934839 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:51:48.934839 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:51:48.934839 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:51:48.934839 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:51:48.934839 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:51:48.934839 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:51:48.934839 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:51:48.935749 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:51:48.935749 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:51:48.935749 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:51:48.935749 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:51:48.935749 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:51:48.935749 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:51:48.935749 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:51:48.935749 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:51:48.935749 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:51:48.935749 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:51:48.935749 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 11:51:48.935749 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:51:48.935749 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 428/856] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 11:51:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:51:48.942236 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24ccc2-c224-4793-a895-3ef8e02e1c9b None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:48.989380 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:49.067762 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24ccc2-c224-4793-a895-3ef8e02e1c9b None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:49.106660 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271eb25-8e1b-479b-aa77-443b692e289b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:49.107271 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271eb25-8e1b-479b-aa77-443b692e289b None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:49.107647 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271eb25-8e1b-479b-aa77-443b692e289b None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:49.107921 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271eb25-8e1b-479b-aa77-443b692e289b None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:49.108645 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271eb25-8e1b-479b-aa77-443b692e289b None admin] RBAC: Adding query filter params (name=service) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:51:49.109068 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271eb25-8e1b-479b-aa77-443b692e289b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:49.110605 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271eb25-8e1b-479b-aa77-443b692e289b None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:49.119853 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 429/857] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 11:51:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:51:49.126737 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa432117-6881-4d45-bd39-0d0fdc2d2c64 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:49.228235 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:49.246756 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa432117-6881-4d45-bd39-0d0fdc2d2c64 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:49.287948 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cdd70-3bc1-4b88-a4fc-1bea1fc73e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:49.289139 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cdd70-3bc1-4b88-a4fc-1bea1fc73e02 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:49.289589 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cdd70-3bc1-4b88-a4fc-1bea1fc73e02 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:49.290193 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cdd70-3bc1-4b88-a4fc-1bea1fc73e02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:49.306575 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26cdd70-3bc1-4b88-a4fc-1bea1fc73e02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:49.309095 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26cdd70-3bc1-4b88-a4fc-1bea1fc73e02 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:49.330509 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-d26cdd70-3bc1-4b88-a4fc-1bea1fc73e02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:51:49.330509 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:51:49.330509 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:51:49.330509 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:51:49.330509 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:51:49.330509 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:51:49.330509 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:51:49.330509 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:51:49.330509 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:51:49.330509 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:51:49.330509 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:51:49.330509 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:51:49.330509 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:51:49.330509 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:51:49.330509 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:51:49.330509 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:51:49.331635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:51:49.331635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:51:49.331635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:51:49.331635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:51:49.331635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:51:49.331635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:51:49.331635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:51:49.331635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:51:49.331635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:51:49.331635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:51:49.331635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:51:49.331635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:51:49.331635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:51:49.331635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:51:49.331635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:51:49.331635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:51:49.331635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:51:49.337283 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:51:49.337283 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:51:49.337283 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:51:49.337283 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 429/858] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:51:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:51:49.337665 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271eb25-8e1b-479b-aa77-443b692e289b None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:49.460796 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271eb25-8e1b-479b-aa77-443b692e289b None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:49.463593 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:49.496859 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd5606-3659-4e5a-b0a8-7b129847f1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:49.497388 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd5606-3659-4e5a-b0a8-7b129847f1e5 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:49.497704 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd5606-3659-4e5a-b0a8-7b129847f1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:49.497975 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd5606-3659-4e5a-b0a8-7b129847f1e5 None admin] PATH_INFO: `/v3/domains` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:49.498791 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd5606-3659-4e5a-b0a8-7b129847f1e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:51:49.499096 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd5606-3659-4e5a-b0a8-7b129847f1e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:49.501344 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd5606-3659-4e5a-b0a8-7b129847f1e5 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:49.514229 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 430/859] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:51:49.520496 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cdd70-3bc1-4b88-a4fc-1bea1fc73e02 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:49.631302 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cdd70-3bc1-4b88-a4fc-1bea1fc73e02 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:49.671178 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b1371-64e6-4307-91bb-59322af7d9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:49.672550 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b1371-64e6-4307-91bb-59322af7d9d0 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:49.672856 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b1371-64e6-4307-91bb-59322af7d9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:49.673128 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b1371-64e6-4307-91bb-59322af7d9d0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:49.676343 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:49.682993 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b1371-64e6-4307-91bb-59322af7d9d0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:49.684703 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b1371-64e6-4307-91bb-59322af7d9d0 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:49.699903 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-616b1371-64e6-4307-91bb-59322af7d9d0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 21 11:51:49.699903 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:51:49.699903 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:51:49.699903 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:51:49.699903 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:51:49.699903 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:51:49.699903 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:51:49.699903 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:51:49.699903 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:51:49.699903 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:51:49.699903 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:51:49.699903 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:51:49.699903 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 11:51:49.699903 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 11:51:49.699903 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 11:51:49.699903 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 11:51:49.701234 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:51:49.701234 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:51:49.701234 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 11:51:49.701234 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:51:49.701234 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 11:51:49.701234 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:51:49.701234 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:51:49.701234 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:51:49.701234 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:51:49.701234 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:51:49.701234 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:51:49.701234 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:51:49.701234 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:51:49.701234 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:51:49.701234 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:51:49.701234 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:51:49.701234 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:51:49.701234 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:51:49.707077 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:51:49.707077 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:51:49.707077 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 11:51:49.707077 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 11:51:49.707077 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 11:51:49.707077 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 11:51:49.707077 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 11:51:49.707077 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 11:51:49.707077 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 21 11:51:49.707077 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:51:49.707077 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 430/860] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:51:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:51:49.707797 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd5606-3659-4e5a-b0a8-7b129847f1e5 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:49.833322 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd5606-3659-4e5a-b0a8-7b129847f1e5 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:49.882160 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c7b36-cdd4-412f-a6fa-1309546ee742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:49.882865 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c7b36-cdd4-412f-a6fa-1309546ee742 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:49.883202 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c7b36-cdd4-412f-a6fa-1309546ee742 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:49.883545 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c7b36-cdd4-412f-a6fa-1309546ee742 None admin] PATH_INFO: `/v3/users` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:49.884391 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c7b36-cdd4-412f-a6fa-1309546ee742 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:51:49.884694 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c7b36-cdd4-412f-a6fa-1309546ee742 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:49.886126 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c7b36-cdd4-412f-a6fa-1309546ee742 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:49.909112 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 431/861] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Sep 21 11:51:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:51:49.915335 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b1371-64e6-4307-91bb-59322af7d9d0 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:50.032962 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b1371-64e6-4307-91bb-59322af7d9d0 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:50.071091 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cec033-9b5b-480c-aae9-a799740ab716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:50.071731 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cec033-9b5b-480c-aae9-a799740ab716 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:50.072041 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cec033-9b5b-480c-aae9-a799740ab716 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:50.072458 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cec033-9b5b-480c-aae9-a799740ab716 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:50.143432 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:50.150685 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cec033-9b5b-480c-aae9-a799740ab716 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:50.152170 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cec033-9b5b-480c-aae9-a799740ab716 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:50.266717 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 431/862] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:51:49 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 11:51:50.272684 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c7b36-cdd4-412f-a6fa-1309546ee742 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:50.305186 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:50.401166 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c7b36-cdd4-412f-a6fa-1309546ee742 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:50.440819 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9084a-6a0a-4f9e-a0d3-8fafcb6d0d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:50.441513 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9084a-6a0a-4f9e-a0d3-8fafcb6d0d3c None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:50.441808 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9084a-6a0a-4f9e-a0d3-8fafcb6d0d3c None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:50.442151 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9084a-6a0a-4f9e-a0d3-8fafcb6d0d3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:50.454144 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9084a-6a0a-4f9e-a0d3-8fafcb6d0d3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:50.456617 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9084a-6a0a-4f9e-a0d3-8fafcb6d0d3c None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:50.473206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-3fc9084a-6a0a-4f9e-a0d3-8fafcb6d0d3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:51:50.473206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:51:50.473206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:51:50.473206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:51:50.473206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:51:50.473206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:51:50.473206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:51:50.473206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:51:50.473206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:51:50.473206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:51:50.473206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:51:50.473206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:51:50.473206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:51:50.473206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:51:50.473206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:51:50.473206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:51:50.474318 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:51:50.474318 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:51:50.474318 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:51:50.474318 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:51:50.474318 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:51:50.474318 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:51:50.474318 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:51:50.474318 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:51:50.474318 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:51:50.474318 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:51:50.474318 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:51:50.474318 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:51:50.474318 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:51:50.474318 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:51:50.474318 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:51:50.474318 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:51:50.474318 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:51:50.475290 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:51:50.475290 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:51:50.475290 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:51:50.475290 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 432/863] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:51:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:51:50.482329 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cec033-9b5b-480c-aae9-a799740ab716 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:50.608513 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:50.620590 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cec033-9b5b-480c-aae9-a799740ab716 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:50.659580 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab73207-3d19-437a-b1cc-4a49a47b71a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:50.660102 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab73207-3d19-437a-b1cc-4a49a47b71a0 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:50.660694 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab73207-3d19-437a-b1cc-4a49a47b71a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:50.661000 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab73207-3d19-437a-b1cc-4a49a47b71a0 None admin] PATH_INFO: `/v3/domains` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:50.661638 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab73207-3d19-437a-b1cc-4a49a47b71a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:51:50.661929 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab73207-3d19-437a-b1cc-4a49a47b71a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:50.663284 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab73207-3d19-437a-b1cc-4a49a47b71a0 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:50.675780 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 432/864] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:51:50.681940 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9084a-6a0a-4f9e-a0d3-8fafcb6d0d3c None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:50.778562 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:50.807699 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9084a-6a0a-4f9e-a0d3-8fafcb6d0d3c None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:50.851692 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ed248-bf12-421c-9486-3d20a7221149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:50.852369 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ed248-bf12-421c-9486-3d20a7221149 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:50.852653 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ed248-bf12-421c-9486-3d20a7221149 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:50.852925 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ed248-bf12-421c-9486-3d20a7221149 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:50.860551 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ed248-bf12-421c-9486-3d20a7221149 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:50.861996 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ed248-bf12-421c-9486-3d20a7221149 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:50.874335 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-2c5ed248-bf12-421c-9486-3d20a7221149 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:51:50.874335 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:51:50.874335 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:51:50.874335 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:51:50.874335 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:51:50.874335 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:51:50.874335 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:51:50.874335 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:51:50.874335 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:51:50.874335 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:51:50.874335 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:51:50.874335 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:51:50.874335 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 11:51:50.874335 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 11:51:50.874335 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 11:51:50.875980 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 11:51:50.875980 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:51:50.875980 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:51:50.875980 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:51:50.875980 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:51:50.875980 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:51:50.875980 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:51:50.875980 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:51:50.875980 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:51:50.875980 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:51:50.875980 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:51:50.875980 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:51:50.875980 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:51:50.875980 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:51:50.875980 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:51:50.875980 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:51:50.875980 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:51:50.877420 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 11:51:50.877420 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 11:51:50.877420 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 11:51:50.877420 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 11:51:50.877420 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 11:51:50.877420 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 11:51:50.877420 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:51:50.877420 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:51:50.877420 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 433/865] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:51:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 11:51:50.882536 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab73207-3d19-437a-b1cc-4a49a47b71a0 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:51.008936 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab73207-3d19-437a-b1cc-4a49a47b71a0 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:51.043434 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69bc174-27c9-4c01-8da7-2a792ded0148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:51.044240 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bc174-27c9-4c01-8da7-2a792ded0148 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:51.044533 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bc174-27c9-4c01-8da7-2a792ded0148 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:51.044784 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bc174-27c9-4c01-8da7-2a792ded0148 None admin] PATH_INFO: `/v3/projects` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:51.045472 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69bc174-27c9-4c01-8da7-2a792ded0148 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:51:51.045789 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69bc174-27c9-4c01-8da7-2a792ded0148 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:51.047729 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69bc174-27c9-4c01-8da7-2a792ded0148 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:51.059921 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 433/866] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 11:51:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:51:51.066699 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ed248-bf12-421c-9486-3d20a7221149 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:51.177720 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ed248-bf12-421c-9486-3d20a7221149 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:51.213594 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff975bd7-7058-4dfc-bbea-674669901907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:51.214185 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff975bd7-7058-4dfc-bbea-674669901907 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:51.214456 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff975bd7-7058-4dfc-bbea-674669901907 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:51.214726 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff975bd7-7058-4dfc-bbea-674669901907 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:51.215434 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff975bd7-7058-4dfc-bbea-674669901907 None admin] RBAC: Adding query filter params (role.id=1557d254ce394d9e8d83e9c55cc20445, scope.project.id=1fd87b195f7c46d2a0d621124acce331, user.id=c58b4f9b474c492984a08198cb7df0a0) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:51:51.215733 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff975bd7-7058-4dfc-bbea-674669901907 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:51.217301 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff975bd7-7058-4dfc-bbea-674669901907 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:51.219682 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:51.224890 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 434/867] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 11:51:51 2022] GET /identity/v3/role_assignments?user.id=c58b4f9b474c492984a08198cb7df0a0&scope.project.id=1fd87b195f7c46d2a0d621124acce331&role.id=1557d254ce394d9e8d83e9c55cc20445 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:51:53.759147 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3f0d2-634f-49b2-a211-2f63ce9ad8b8 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:53.759668 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3f0d2-634f-49b2-a211-2f63ce9ad8b8 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:53.759668 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3f0d2-634f-49b2-a211-2f63ce9ad8b8 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:53.761045 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 434/868] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:51:53.766743 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72521ac9-2f88-4101-a261-6a1c9fc594ba None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:53.767184 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72521ac9-2f88-4101-a261-6a1c9fc594ba None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:53.767275 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72521ac9-2f88-4101-a261-6a1c9fc594ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:53.786256 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-72521ac9-2f88-4101-a261-6a1c9fc594ba None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:51:53.787442 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-72521ac9-2f88-4101-a261-6a1c9fc594ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:51:53.852043 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 435/869] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:51:53 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 11:51:54.174269 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3f0d2-634f-49b2-a211-2f63ce9ad8b8 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:54.192655 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:54.274667 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3f0d2-634f-49b2-a211-2f63ce9ad8b8 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:54.311220 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979936c-0472-4861-aa91-908603f04fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:54.311819 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979936c-0472-4861-aa91-908603f04fa8 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:54.312683 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979936c-0472-4861-aa91-908603f04fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:54.312987 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979936c-0472-4861-aa91-908603f04fa8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:54.324223 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979936c-0472-4861-aa91-908603f04fa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:51:54.330193 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-5979936c-0472-4861-aa91-908603f04fa8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:51:54.330193 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:51:54.330193 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:51:54.330193 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:51:54.330193 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:51:54.330193 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:51:54.330193 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:51:54.330193 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:51:54.330193 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:51:54.330193 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:51:54.330193 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:51:54.330193 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:51:54.330193 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:51:54.330193 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:51:54.330193 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:51:54.330193 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:51:54.331165 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:51:54.331165 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:51:54.331165 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:51:54.331165 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:51:54.331165 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:51:54.331165 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:51:54.331165 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:51:54.331165 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:51:54.331165 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:51:54.331165 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:51:54.331165 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:51:54.331165 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:51:54.331165 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:51:54.331165 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:51:54.331165 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:51:54.331165 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:51:54.332079 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:51:54.332079 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:51:54.332079 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:51:54.332079 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:51:54.332079 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:51:54.332079 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:51:54.332079 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:51:54.332079 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:51:54.332079 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:51:54.332079 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:51:54.332079 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:51:54.332079 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:51:54.332079 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 435/870] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 11:51:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:51:54.337572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72521ac9-2f88-4101-a261-6a1c9fc594ba None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:54.432612 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72521ac9-2f88-4101-a261-6a1c9fc594ba None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:54.458920 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:54.466673 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2286a-17a5-4e39-8fb6-818aa0afcbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:54.467262 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2286a-17a5-4e39-8fb6-818aa0afcbdc None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:54.467534 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2286a-17a5-4e39-8fb6-818aa0afcbdc None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:54.467796 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2286a-17a5-4e39-8fb6-818aa0afcbdc None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:54.468512 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2286a-17a5-4e39-8fb6-818aa0afcbdc None admin] RBAC: Adding query filter params (name=admin) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:51:54.468809 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2286a-17a5-4e39-8fb6-818aa0afcbdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:54.470146 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2286a-17a5-4e39-8fb6-818aa0afcbdc None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:54.477816 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 436/871] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:51:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 11:51:54.483546 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979936c-0472-4861-aa91-908603f04fa8 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:54.558701 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:54.581987 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979936c-0472-4861-aa91-908603f04fa8 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:54.615459 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e38a3-2c25-49f9-82d9-0ef80007bf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:54.616106 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e38a3-2c25-49f9-82d9-0ef80007bf90 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:54.616383 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e38a3-2c25-49f9-82d9-0ef80007bf90 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:54.616648 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e38a3-2c25-49f9-82d9-0ef80007bf90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:54.627515 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e38a3-2c25-49f9-82d9-0ef80007bf90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:54.629085 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e38a3-2c25-49f9-82d9-0ef80007bf90 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:54.643223 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-044e38a3-2c25-49f9-82d9-0ef80007bf90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:51:54.643223 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:51:54.643223 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:51:54.643223 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:51:54.643223 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:51:54.643223 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:51:54.643223 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:51:54.643223 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:51:54.643223 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:51:54.643223 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:51:54.643223 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:51:54.643223 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:51:54.643223 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:51:54.643223 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:51:54.643223 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:51:54.643223 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:51:54.644376 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:51:54.644376 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:51:54.644376 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:51:54.644376 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:51:54.644376 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:51:54.644376 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:51:54.644376 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:51:54.644376 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:51:54.644376 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:51:54.644376 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:51:54.644376 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:51:54.644376 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:51:54.644376 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:51:54.644376 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:51:54.644376 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:51:54.644376 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:51:54.644376 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:51:54.645453 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:51:54.645453 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:51:54.645453 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:51:54.645453 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 436/872] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:51:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:51:54.650053 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2286a-17a5-4e39-8fb6-818aa0afcbdc None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:54.746236 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2286a-17a5-4e39-8fb6-818aa0afcbdc None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:54.778437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42321309-b467-43ec-9286-a9896ca6883c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:54.779035 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42321309-b467-43ec-9286-a9896ca6883c None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:54.779280 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42321309-b467-43ec-9286-a9896ca6883c None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:54.779544 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42321309-b467-43ec-9286-a9896ca6883c None admin] PATH_INFO: `/v3/domains` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:54.780196 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42321309-b467-43ec-9286-a9896ca6883c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:51:54.780492 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42321309-b467-43ec-9286-a9896ca6883c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:54.781838 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42321309-b467-43ec-9286-a9896ca6883c None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:54.793214 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 437/873] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:51:54.799401 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e38a3-2c25-49f9-82d9-0ef80007bf90 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:54.894256 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e38a3-2c25-49f9-82d9-0ef80007bf90 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:54.919524 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:54.927914 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eee243-e94d-45d4-9bb8-d2e1d090cf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:54.928540 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eee243-e94d-45d4-9bb8-d2e1d090cf85 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:54.928811 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eee243-e94d-45d4-9bb8-d2e1d090cf85 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:54.929076 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eee243-e94d-45d4-9bb8-d2e1d090cf85 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:54.937341 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eee243-e94d-45d4-9bb8-d2e1d090cf85 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:54.938889 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eee243-e94d-45d4-9bb8-d2e1d090cf85 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:54.949622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-b3eee243-e94d-45d4-9bb8-d2e1d090cf85 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 21 11:51:54.949622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:51:54.949622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:51:54.949622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:51:54.949622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:51:54.949622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:51:54.949622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:51:54.949622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:51:54.949622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:51:54.949622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:51:54.949622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:51:54.949622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:51:54.949622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 11:51:54.949622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 11:51:54.949622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 11:51:54.949622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 11:51:54.950774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:51:54.950774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:51:54.950774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 11:51:54.950774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:51:54.950774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 11:51:54.950774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:51:54.950774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:51:54.950774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:51:54.950774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:51:54.950774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:51:54.950774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:51:54.950774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:51:54.950774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:51:54.950774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:51:54.950774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:51:54.950774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:51:54.950774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:51:54.950774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:51:54.951944 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:51:54.951944 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:51:54.951944 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 11:51:54.951944 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 11:51:54.951944 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 11:51:54.951944 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 11:51:54.951944 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 11:51:54.951944 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 11:51:54.951944 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 21 11:51:54.951944 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:51:54.955346 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 437/874] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:51:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:51:54.956524 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42321309-b467-43ec-9286-a9896ca6883c None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:55.005147 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:55.053877 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42321309-b467-43ec-9286-a9896ca6883c None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:55.085465 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb4a6c-440d-41b5-ae6f-1cbfa736fec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:55.086046 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb4a6c-440d-41b5-ae6f-1cbfa736fec8 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:55.086315 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb4a6c-440d-41b5-ae6f-1cbfa736fec8 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:55.086577 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb4a6c-440d-41b5-ae6f-1cbfa736fec8 None admin] PATH_INFO: `/v3/users` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:55.087280 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb4a6c-440d-41b5-ae6f-1cbfa736fec8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:51:55.087574 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb4a6c-440d-41b5-ae6f-1cbfa736fec8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:55.088995 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb4a6c-440d-41b5-ae6f-1cbfa736fec8 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:55.105475 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 438/875] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Sep 21 11:51:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:51:55.111902 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eee243-e94d-45d4-9bb8-d2e1d090cf85 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:55.210252 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eee243-e94d-45d4-9bb8-d2e1d090cf85 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:55.242539 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8f6f4-57b3-4e35-ad7f-0690e91b4f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:55.243125 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8f6f4-57b3-4e35-ad7f-0690e91b4f27 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:55.243398 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8f6f4-57b3-4e35-ad7f-0690e91b4f27 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:55.243664 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8f6f4-57b3-4e35-ad7f-0690e91b4f27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:55.301765 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:55.314457 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8f6f4-57b3-4e35-ad7f-0690e91b4f27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:55.315906 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8f6f4-57b3-4e35-ad7f-0690e91b4f27 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:55.409955 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 438/876] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:51:55 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 11:51:55.416673 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb4a6c-440d-41b5-ae6f-1cbfa736fec8 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:55.513032 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb4a6c-440d-41b5-ae6f-1cbfa736fec8 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:55.522239 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:55.546889 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2bea1-f094-4394-a51b-54f287f8e2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:55.547496 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2bea1-f094-4394-a51b-54f287f8e2f2 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:55.547768 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2bea1-f094-4394-a51b-54f287f8e2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:55.548074 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2bea1-f094-4394-a51b-54f287f8e2f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:55.557610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2bea1-f094-4394-a51b-54f287f8e2f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:55.558977 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2bea1-f094-4394-a51b-54f287f8e2f2 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:55.572831 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-6ed2bea1-f094-4394-a51b-54f287f8e2f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:51:55.572831 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:51:55.572831 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:51:55.572831 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:51:55.572831 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:51:55.572831 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:51:55.572831 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:51:55.572831 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:51:55.572831 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:51:55.572831 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:51:55.572831 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:51:55.572831 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:51:55.572831 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:51:55.572831 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:51:55.572831 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:51:55.572831 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:51:55.573950 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:51:55.573950 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:51:55.573950 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:51:55.573950 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:51:55.573950 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:51:55.573950 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:51:55.573950 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:51:55.573950 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:51:55.573950 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:51:55.573950 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:51:55.573950 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:51:55.573950 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:51:55.573950 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:51:55.573950 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:51:55.573950 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:51:55.573950 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:51:55.573950 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:51:55.575007 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:51:55.575007 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:51:55.575007 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:51:55.575007 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 439/877] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:51:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:51:55.580149 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8f6f4-57b3-4e35-ad7f-0690e91b4f27 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:55.663599 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:55.675303 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8f6f4-57b3-4e35-ad7f-0690e91b4f27 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:55.709341 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99561c8e-ae66-47d7-a3d6-67b8215f2221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:55.709922 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99561c8e-ae66-47d7-a3d6-67b8215f2221 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:55.710192 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99561c8e-ae66-47d7-a3d6-67b8215f2221 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:55.710456 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99561c8e-ae66-47d7-a3d6-67b8215f2221 None admin] PATH_INFO: `/v3/domains` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:55.711082 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99561c8e-ae66-47d7-a3d6-67b8215f2221 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:51:55.711374 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99561c8e-ae66-47d7-a3d6-67b8215f2221 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:55.712735 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99561c8e-ae66-47d7-a3d6-67b8215f2221 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:55.723416 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 439/878] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:51:55.729147 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2bea1-f094-4394-a51b-54f287f8e2f2 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:55.823660 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2bea1-f094-4394-a51b-54f287f8e2f2 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:55.855543 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86cdefd-6697-402b-9bea-ade5e17f12cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:55.856173 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cdefd-6697-402b-9bea-ade5e17f12cf None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:55.856445 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cdefd-6697-402b-9bea-ade5e17f12cf None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:55.856708 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cdefd-6697-402b-9bea-ade5e17f12cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:55.862990 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86cdefd-6697-402b-9bea-ade5e17f12cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:55.864438 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86cdefd-6697-402b-9bea-ade5e17f12cf None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:55.876373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-b86cdefd-6697-402b-9bea-ade5e17f12cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:51:55.876373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:51:55.876373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:51:55.876373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:51:55.876373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:51:55.876373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:51:55.876373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:51:55.876373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:51:55.876373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:51:55.876373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:51:55.876373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:51:55.876373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:51:55.876373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 11:51:55.876373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 11:51:55.876373 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 11:51:55.877404 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 11:51:55.877404 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:51:55.877404 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:51:55.877404 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:51:55.877404 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:51:55.877404 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:51:55.877404 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:51:55.877404 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:51:55.877404 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:51:55.877404 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:51:55.877404 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:51:55.877404 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:51:55.877404 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:51:55.877404 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:51:55.877404 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:51:55.877404 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:51:55.877404 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:51:55.878364 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 11:51:55.878364 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 11:51:55.878364 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 11:51:55.878364 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 11:51:55.878364 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 11:51:55.878364 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 11:51:55.878364 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:51:55.878364 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:51:55.878364 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 440/879] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:51:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:51:55.883277 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99561c8e-ae66-47d7-a3d6-67b8215f2221 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:55.977766 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99561c8e-ae66-47d7-a3d6-67b8215f2221 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:56.010952 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64b9dd-afb5-4653-ae4f-2f05c12fd883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:56.011543 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64b9dd-afb5-4653-ae4f-2f05c12fd883 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:56.011818 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64b9dd-afb5-4653-ae4f-2f05c12fd883 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:56.012117 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64b9dd-afb5-4653-ae4f-2f05c12fd883 None admin] PATH_INFO: `/v3/projects` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:56.012802 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64b9dd-afb5-4653-ae4f-2f05c12fd883 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:51:56.013103 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64b9dd-afb5-4653-ae4f-2f05c12fd883 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:56.014515 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64b9dd-afb5-4653-ae4f-2f05c12fd883 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:56.025993 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 440/880] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 11:51:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:51:56.032010 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86cdefd-6697-402b-9bea-ade5e17f12cf None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:56.055444 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:56.129306 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86cdefd-6697-402b-9bea-ade5e17f12cf None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:56.162027 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465450e-7ff2-41bf-9f04-2a86d2677458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:56.162605 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465450e-7ff2-41bf-9f04-2a86d2677458 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:56.162875 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465450e-7ff2-41bf-9f04-2a86d2677458 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:56.163139 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465450e-7ff2-41bf-9f04-2a86d2677458 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:56.163840 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2465450e-7ff2-41bf-9f04-2a86d2677458 None admin] RBAC: Adding query filter params (role.id=d1f3d1431da145709a5e9b374f3b403d, scope.project.id=1fd87b195f7c46d2a0d621124acce331, user.id=c58b4f9b474c492984a08198cb7df0a0) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:51:56.164172 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2465450e-7ff2-41bf-9f04-2a86d2677458 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:56.165580 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2465450e-7ff2-41bf-9f04-2a86d2677458 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:56.170666 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 441/881] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 11:51:56 2022] GET /identity/v3/role_assignments?user.id=c58b4f9b474c492984a08198cb7df0a0&scope.project.id=1fd87b195f7c46d2a0d621124acce331&role.id=d1f3d1431da145709a5e9b374f3b403d => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:51:58.522089 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6472a6-61ad-4f14-a434-876ab2f253b7 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:58.522650 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6472a6-61ad-4f14-a434-876ab2f253b7 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:58.522650 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6472a6-61ad-4f14-a434-876ab2f253b7 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:58.523946 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 441/882] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:51:58.529149 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f940e-d017-4853-8b31-5461e1fe57d0 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:58.529568 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f940e-d017-4853-8b31-5461e1fe57d0 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:58.529705 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f940e-d017-4853-8b31-5461e1fe57d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:58.548189 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-471f940e-d017-4853-8b31-5461e1fe57d0 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:51:58.549353 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-471f940e-d017-4853-8b31-5461e1fe57d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:51:58.614125 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 442/883] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:51:58 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 11:51:58.927497 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6472a6-61ad-4f14-a434-876ab2f253b7 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:58.938856 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:59.028254 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6472a6-61ad-4f14-a434-876ab2f253b7 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:59.061793 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5375c1d-df60-45be-be10-4cc2d348f897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:59.062947 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5375c1d-df60-45be-be10-4cc2d348f897 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:59.063221 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5375c1d-df60-45be-be10-4cc2d348f897 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:59.063487 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5375c1d-df60-45be-be10-4cc2d348f897 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:59.073130 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5375c1d-df60-45be-be10-4cc2d348f897 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:51:59.077864 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-a5375c1d-df60-45be-be10-4cc2d348f897 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:51:59.077864 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:51:59.077864 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:51:59.077864 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:51:59.077864 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:51:59.077864 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:51:59.077864 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:51:59.077864 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:51:59.077864 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:51:59.077864 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:51:59.077864 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:51:59.077864 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:51:59.077864 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:51:59.077864 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:51:59.077864 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:51:59.077864 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:51:59.078966 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:51:59.078966 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:51:59.078966 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:51:59.078966 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:51:59.078966 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:51:59.078966 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:51:59.078966 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:51:59.078966 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:51:59.078966 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:51:59.078966 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:51:59.078966 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:51:59.078966 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:51:59.078966 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:51:59.078966 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:51:59.078966 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:51:59.078966 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:51:59.079834 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:51:59.079834 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:51:59.079834 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:51:59.079834 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:51:59.079834 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:51:59.079834 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:51:59.079834 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:51:59.079834 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:51:59.079834 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:51:59.079834 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:51:59.079834 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:51:59.079834 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:51:59.079834 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 442/884] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 11:51:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:51:59.086983 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f940e-d017-4853-8b31-5461e1fe57d0 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:59.101489 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:59.183530 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f940e-d017-4853-8b31-5461e1fe57d0 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:59.215778 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b00f5-0ff4-4c49-86ec-4e7c12a74d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:59.216399 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b00f5-0ff4-4c49-86ec-4e7c12a74d95 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:59.216676 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b00f5-0ff4-4c49-86ec-4e7c12a74d95 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:59.216945 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b00f5-0ff4-4c49-86ec-4e7c12a74d95 None admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:59.217594 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b00f5-0ff4-4c49-86ec-4e7c12a74d95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:51:59.217890 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b00f5-0ff4-4c49-86ec-4e7c12a74d95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:59.219235 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b00f5-0ff4-4c49-86ec-4e7c12a74d95 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:59.226875 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 443/885] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:51:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:51:59.232486 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5375c1d-df60-45be-be10-4cc2d348f897 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:59.306534 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:59.345913 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5375c1d-df60-45be-be10-4cc2d348f897 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:59.378345 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4c9a5-4ab8-40e7-894b-d6cf54f833f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:59.378954 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4c9a5-4ab8-40e7-894b-d6cf54f833f0 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:59.379226 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4c9a5-4ab8-40e7-894b-d6cf54f833f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:59.379491 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4c9a5-4ab8-40e7-894b-d6cf54f833f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:59.389471 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4c9a5-4ab8-40e7-894b-d6cf54f833f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:59.391456 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4c9a5-4ab8-40e7-894b-d6cf54f833f0 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:59.404905 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-4ef4c9a5-4ab8-40e7-894b-d6cf54f833f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:51:59.404905 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:51:59.404905 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:51:59.404905 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:51:59.404905 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:51:59.404905 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:51:59.404905 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:51:59.404905 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:51:59.404905 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:51:59.404905 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:51:59.404905 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:51:59.404905 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:51:59.404905 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:51:59.404905 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:51:59.404905 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:51:59.404905 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:51:59.405865 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:51:59.405865 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:51:59.405865 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:51:59.405865 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:51:59.405865 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:51:59.405865 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:51:59.405865 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:51:59.405865 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:51:59.405865 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:51:59.405865 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:51:59.405865 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:51:59.405865 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:51:59.405865 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:51:59.405865 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:51:59.405865 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:51:59.405865 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:51:59.405865 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:51:59.406929 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:51:59.406929 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:51:59.406929 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:51:59.406929 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 443/886] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:51:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:51:59.412186 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b00f5-0ff4-4c49-86ec-4e7c12a74d95 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:59.485690 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:59.510311 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b00f5-0ff4-4c49-86ec-4e7c12a74d95 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:59.542589 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64743768-74a5-476b-a80a-d823409d63cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:59.543217 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64743768-74a5-476b-a80a-d823409d63cb None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:59.543490 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64743768-74a5-476b-a80a-d823409d63cb None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:59.543758 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64743768-74a5-476b-a80a-d823409d63cb None admin] PATH_INFO: `/v3/domains` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:59.544417 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64743768-74a5-476b-a80a-d823409d63cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:51:59.544744 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64743768-74a5-476b-a80a-d823409d63cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:59.546092 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64743768-74a5-476b-a80a-d823409d63cb None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:59.557232 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 444/887] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:51:59.563284 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4c9a5-4ab8-40e7-894b-d6cf54f833f0 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:59.659780 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4c9a5-4ab8-40e7-894b-d6cf54f833f0 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:59.679201 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:59.692904 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35e81f-3ad9-4ea5-87eb-fa7efe96b0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:59.693523 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35e81f-3ad9-4ea5-87eb-fa7efe96b0bc None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:59.693796 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35e81f-3ad9-4ea5-87eb-fa7efe96b0bc None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:59.694062 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35e81f-3ad9-4ea5-87eb-fa7efe96b0bc None admin] PATH_INFO: `/v3/users/placement` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:59.701277 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35e81f-3ad9-4ea5-87eb-fa7efe96b0bc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:59.703225 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35e81f-3ad9-4ea5-87eb-fa7efe96b0bc None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:59.713930 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-4f35e81f-3ad9-4ea5-87eb-fa7efe96b0bc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 21 11:51:59.713930 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:51:59.713930 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:51:59.713930 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:51:59.713930 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:51:59.713930 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:51:59.713930 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:51:59.713930 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:51:59.713930 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:51:59.713930 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:51:59.713930 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:51:59.713930 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:51:59.713930 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 11:51:59.713930 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 11:51:59.713930 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 11:51:59.713930 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 11:51:59.720297 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:51:59.720297 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:51:59.720297 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 11:51:59.720297 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:51:59.720297 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 11:51:59.720297 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:51:59.720297 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:51:59.720297 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:51:59.720297 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:51:59.720297 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:51:59.720297 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:51:59.720297 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:51:59.720297 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:51:59.720297 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:51:59.720297 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:51:59.720297 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:51:59.720297 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:51:59.720297 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:51:59.721534 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:51:59.721534 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:51:59.721534 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 11:51:59.721534 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 11:51:59.721534 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 11:51:59.721534 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 11:51:59.721534 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 11:51:59.721534 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 11:51:59.721534 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 21 11:51:59.721534 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:51:59.721534 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 444/888] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:51:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:51:59.722272 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64743768-74a5-476b-a80a-d823409d63cb None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:59.816911 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64743768-74a5-476b-a80a-d823409d63cb None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:51:59.855589 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236155c4-7e47-4639-96d2-767a3c73c891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:51:59.856217 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236155c4-7e47-4639-96d2-767a3c73c891 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:51:59.856495 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236155c4-7e47-4639-96d2-767a3c73c891 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:51:59.856763 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236155c4-7e47-4639-96d2-767a3c73c891 None admin] PATH_INFO: `/v3/users` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:51:59.857476 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236155c4-7e47-4639-96d2-767a3c73c891 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:51:59.857775 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236155c4-7e47-4639-96d2-767a3c73c891 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:51:59.859214 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236155c4-7e47-4639-96d2-767a3c73c891 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:51:59.861673 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:51:59.876944 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 445/889] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Sep 21 11:51:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:51:59.882635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35e81f-3ad9-4ea5-87eb-fa7efe96b0bc None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:51:59.982462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35e81f-3ad9-4ea5-87eb-fa7efe96b0bc None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:52:00.014405 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802ca97-c1df-455d-8f4f-655c4112ec6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:52:00.015514 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802ca97-c1df-455d-8f4f-655c4112ec6a None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:00.015791 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802ca97-c1df-455d-8f4f-655c4112ec6a None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:00.016153 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802ca97-c1df-455d-8f4f-655c4112ec6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:00.026145 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802ca97-c1df-455d-8f4f-655c4112ec6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:52:00.027572 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802ca97-c1df-455d-8f4f-655c4112ec6a None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:52:00.041945 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-3802ca97-c1df-455d-8f4f-655c4112ec6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:52:00.041945 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:52:00.041945 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:52:00.041945 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:52:00.041945 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:52:00.041945 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:52:00.041945 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:52:00.041945 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:52:00.041945 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:52:00.041945 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:52:00.041945 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:52:00.041945 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:52:00.041945 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:52:00.041945 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:52:00.041945 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:52:00.041945 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:52:00.042886 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:52:00.042886 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:52:00.042886 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:52:00.042886 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:52:00.042886 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:52:00.042886 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:52:00.042886 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:52:00.042886 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:52:00.042886 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:52:00.042886 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:52:00.042886 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:52:00.042886 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:52:00.042886 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:52:00.042886 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:52:00.042886 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:52:00.042886 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:52:00.042886 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:52:00.043870 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:52:00.043870 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:52:00.043870 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:52:00.043870 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 445/890] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:51:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:52:00.048759 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236155c4-7e47-4639-96d2-767a3c73c891 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:52:00.149890 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236155c4-7e47-4639-96d2-767a3c73c891 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:52:00.184168 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387561e0-51a3-4daa-8341-dc1667fbbda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:52:00.184753 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387561e0-51a3-4daa-8341-dc1667fbbda5 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:00.185023 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387561e0-51a3-4daa-8341-dc1667fbbda5 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:00.185287 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387561e0-51a3-4daa-8341-dc1667fbbda5 None admin] PATH_INFO: `/v3/domains` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:00.185906 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387561e0-51a3-4daa-8341-dc1667fbbda5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:52:00.186195 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387561e0-51a3-4daa-8341-dc1667fbbda5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:52:00.188096 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387561e0-51a3-4daa-8341-dc1667fbbda5 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:52:00.198691 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 446/891] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:52:00.204896 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802ca97-c1df-455d-8f4f-655c4112ec6a None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:52:00.235398 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:52:00.308320 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802ca97-c1df-455d-8f4f-655c4112ec6a None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:52:00.341110 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386f863-f840-4dc6-a983-afc576bdbc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:52:00.341718 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386f863-f840-4dc6-a983-afc576bdbc9a None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:00.341997 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386f863-f840-4dc6-a983-afc576bdbc9a None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:00.342269 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386f863-f840-4dc6-a983-afc576bdbc9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:00.348621 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386f863-f840-4dc6-a983-afc576bdbc9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:52:00.350075 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386f863-f840-4dc6-a983-afc576bdbc9a None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:52:00.361953 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-8386f863-f840-4dc6-a983-afc576bdbc9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:52:00.361953 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:52:00.361953 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:52:00.361953 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:52:00.361953 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:52:00.361953 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:52:00.361953 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:52:00.361953 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:52:00.361953 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:52:00.361953 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:52:00.361953 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:52:00.361953 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:52:00.361953 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 11:52:00.361953 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 11:52:00.361953 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 11:52:00.362853 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 11:52:00.362853 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:52:00.362853 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:52:00.362853 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:52:00.362853 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:52:00.362853 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:52:00.362853 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:52:00.362853 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:52:00.362853 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:52:00.362853 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:52:00.362853 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:52:00.362853 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:52:00.362853 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:52:00.362853 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:52:00.362853 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:52:00.362853 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:52:00.362853 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:52:00.363806 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 11:52:00.363806 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 11:52:00.363806 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 11:52:00.363806 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 11:52:00.363806 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 11:52:00.363806 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 11:52:00.363806 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:52:00.363806 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:52:00.363806 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 446/892] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:52:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:52:00.368866 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387561e0-51a3-4daa-8341-dc1667fbbda5 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:52:00.422759 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:52:00.467855 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387561e0-51a3-4daa-8341-dc1667fbbda5 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:52:00.504134 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188e574-a104-4e32-aca8-73c250dad894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:52:00.504968 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188e574-a104-4e32-aca8-73c250dad894 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:00.505377 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188e574-a104-4e32-aca8-73c250dad894 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:00.505793 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188e574-a104-4e32-aca8-73c250dad894 None admin] PATH_INFO: `/v3/projects` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:00.506729 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188e574-a104-4e32-aca8-73c250dad894 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:52:00.507154 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188e574-a104-4e32-aca8-73c250dad894 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:52:00.509075 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188e574-a104-4e32-aca8-73c250dad894 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:52:00.522048 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 447/893] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 11:52:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:52:00.527953 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386f863-f840-4dc6-a983-afc576bdbc9a None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:52:00.617308 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:52:00.626997 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386f863-f840-4dc6-a983-afc576bdbc9a None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:52:00.658895 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c6fe8-6e14-4aa7-b1d3-e7e755c7d6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:52:00.659530 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c6fe8-6e14-4aa7-b1d3-e7e755c7d6e4 None admin] REQUEST_METHOD: `PUT` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:00.659807 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c6fe8-6e14-4aa7-b1d3-e7e755c7d6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:00.660104 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c6fe8-6e14-4aa7-b1d3-e7e755c7d6e4 None admin] PATH_INFO: `/v3/projects/1fd87b195f7c46d2a0d621124acce331/users/c58b4f9b474c492984a08198cb7df0a0/roles/d1f3d1431da145709a5e9b374f3b403d` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:00.662256 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c6fe8-6e14-4aa7-b1d3-e7e755c7d6e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=1fd87b195f7c46d2a0d621124acce331, user_id=c58b4f9b474c492984a08198cb7df0a0, role_id=d1f3d1431da145709a5e9b374f3b403d)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:52:00.663675 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c6fe8-6e14-4aa7-b1d3-e7e755c7d6e4 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:52:00.676370 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 447/894] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 11:52:00 2022] PUT /identity/v3/projects/1fd87b195f7c46d2a0d621124acce331/users/c58b4f9b474c492984a08198cb7df0a0/roles/d1f3d1431da145709a5e9b374f3b403d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 11:52:03.038467 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56c378-dc7a-4d5d-9947-162e99bf5b03 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:03.039008 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56c378-dc7a-4d5d-9947-162e99bf5b03 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:03.039008 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56c378-dc7a-4d5d-9947-162e99bf5b03 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:03.040358 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 448/895] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:52:03.045388 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f54821-26f4-428a-8107-3ae24c2510c7 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:03.045766 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f54821-26f4-428a-8107-3ae24c2510c7 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:03.045929 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f54821-26f4-428a-8107-3ae24c2510c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:03.065187 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-52f54821-26f4-428a-8107-3ae24c2510c7 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:52:03.066354 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-52f54821-26f4-428a-8107-3ae24c2510c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:52:03.130697 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 448/896] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:52:03 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 11:52:03.478622 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56c378-dc7a-4d5d-9947-162e99bf5b03 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:52:03.576765 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56c378-dc7a-4d5d-9947-162e99bf5b03 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:52:03.590620 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:52:03.610728 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f193b-add6-4c0d-bfb6-52141f0baa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:52:03.611339 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f193b-add6-4c0d-bfb6-52141f0baa06 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:03.611676 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f193b-add6-4c0d-bfb6-52141f0baa06 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:03.611953 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f193b-add6-4c0d-bfb6-52141f0baa06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:03.621603 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f193b-add6-4c0d-bfb6-52141f0baa06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 11:52:03.626944 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-131f193b-add6-4c0d-bfb6-52141f0baa06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:52:03.626944 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:52:03.626944 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:52:03.626944 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:52:03.626944 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:52:03.626944 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:52:03.626944 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:52:03.626944 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:52:03.626944 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:52:03.626944 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:52:03.626944 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:52:03.626944 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:52:03.626944 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 11:52:03.626944 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 11:52:03.626944 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 11:52:03.626944 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 11:52:03.628117 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 11:52:03.628117 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 11:52:03.628117 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 11:52:03.628117 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 11:52:03.628117 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:52:03.628117 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:52:03.628117 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:52:03.628117 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:52:03.628117 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:52:03.628117 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:52:03.628117 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:52:03.628117 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:52:03.628117 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:52:03.628117 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:52:03.628117 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:52:03.628117 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:52:03.629189 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:52:03.629189 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:52:03.629189 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:52:03.629189 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:52:03.629189 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 11:52:03.629189 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 11:52:03.629189 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 11:52:03.629189 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 11:52:03.629189 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 11:52:03.629189 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 11:52:03.629189 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 11:52:03.629189 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:52:03.629189 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 449/897] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 11:52:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:52:03.634271 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f54821-26f4-428a-8107-3ae24c2510c7 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:52:03.711101 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:52:03.729146 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f54821-26f4-428a-8107-3ae24c2510c7 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:52:03.762471 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee6f3e-0af7-473d-a11a-02d96d2a188f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:52:03.763055 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee6f3e-0af7-473d-a11a-02d96d2a188f None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:03.763326 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee6f3e-0af7-473d-a11a-02d96d2a188f None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:03.763591 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee6f3e-0af7-473d-a11a-02d96d2a188f None admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:03.764268 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee6f3e-0af7-473d-a11a-02d96d2a188f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:52:03.764564 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee6f3e-0af7-473d-a11a-02d96d2a188f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:52:03.765915 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee6f3e-0af7-473d-a11a-02d96d2a188f None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:52:03.773673 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 449/898] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 11:52:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:52:03.779456 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f193b-add6-4c0d-bfb6-52141f0baa06 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:52:03.876005 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f193b-add6-4c0d-bfb6-52141f0baa06 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:52:03.908589 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0474a-ea1f-4caf-a52c-272e9000a1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:52:03.909191 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0474a-ea1f-4caf-a52c-272e9000a1e1 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:03.909464 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0474a-ea1f-4caf-a52c-272e9000a1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:03.909735 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0474a-ea1f-4caf-a52c-272e9000a1e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:03.919563 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0474a-ea1f-4caf-a52c-272e9000a1e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:52:03.921006 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0474a-ea1f-4caf-a52c-272e9000a1e1 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:52:03.935653 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-efa0474a-ea1f-4caf-a52c-272e9000a1e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:52:03.935653 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:52:03.935653 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:52:03.935653 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:52:03.935653 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:52:03.935653 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:52:03.935653 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:52:03.935653 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:52:03.935653 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:52:03.935653 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:52:03.935653 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:52:03.935653 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:52:03.935653 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:52:03.935653 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:52:03.935653 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:52:03.935653 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:52:03.936799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:52:03.936799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:52:03.936799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:52:03.936799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:52:03.936799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:52:03.936799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:52:03.936799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:52:03.936799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:52:03.936799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:52:03.936799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:52:03.936799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:52:03.936799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:52:03.936799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:52:03.936799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:52:03.936799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:52:03.936799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:52:03.936799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:52:03.937915 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:52:03.937915 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:52:03.937915 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:52:03.937915 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 450/899] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:52:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:52:03.944131 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee6f3e-0af7-473d-a11a-02d96d2a188f None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:52:04.040424 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee6f3e-0af7-473d-a11a-02d96d2a188f None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:52:04.072402 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa5255-98ce-4a35-9bc1-341b641cbaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:52:04.072971 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa5255-98ce-4a35-9bc1-341b641cbaab None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:04.073243 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa5255-98ce-4a35-9bc1-341b641cbaab None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:04.073509 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa5255-98ce-4a35-9bc1-341b641cbaab None admin] PATH_INFO: `/v3/domains` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:04.074131 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa5255-98ce-4a35-9bc1-341b641cbaab None admin] RBAC: Adding query filter params (name=Default) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:52:04.074425 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa5255-98ce-4a35-9bc1-341b641cbaab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:52:04.075768 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa5255-98ce-4a35-9bc1-341b641cbaab None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:52:04.086999 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 450/900] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:52:04.092700 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0474a-ea1f-4caf-a52c-272e9000a1e1 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:52:04.121479 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:52:04.196824 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0474a-ea1f-4caf-a52c-272e9000a1e1 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:52:04.230749 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253c76b-2b90-4df4-9ff3-e8ca91ce916d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:52:04.231360 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253c76b-2b90-4df4-9ff3-e8ca91ce916d None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:04.231634 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253c76b-2b90-4df4-9ff3-e8ca91ce916d None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:04.231900 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253c76b-2b90-4df4-9ff3-e8ca91ce916d None admin] PATH_INFO: `/v3/users/placement` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:04.239138 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253c76b-2b90-4df4-9ff3-e8ca91ce916d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:52:04.240594 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253c76b-2b90-4df4-9ff3-e8ca91ce916d None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:52:04.251242 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-0253c76b-2b90-4df4-9ff3-e8ca91ce916d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 21 11:52:04.251242 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:52:04.251242 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:52:04.251242 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:52:04.251242 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:52:04.251242 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:52:04.251242 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:52:04.251242 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:52:04.251242 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:52:04.251242 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:52:04.251242 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:52:04.251242 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:52:04.251242 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 11:52:04.251242 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 11:52:04.251242 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 11:52:04.251242 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 11:52:04.252439 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:52:04.252439 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:52:04.252439 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 11:52:04.252439 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:52:04.252439 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 11:52:04.252439 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 11:52:04.252439 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:52:04.252439 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:52:04.252439 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:52:04.252439 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:52:04.252439 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:52:04.252439 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:52:04.252439 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:52:04.252439 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:52:04.252439 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:52:04.252439 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:52:04.252439 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:52:04.252439 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:52:04.253839 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:52:04.253839 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:52:04.253839 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 11:52:04.253839 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 11:52:04.253839 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 11:52:04.253839 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 11:52:04.253839 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 11:52:04.253839 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 11:52:04.253839 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 21 11:52:04.253839 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:52:04.253839 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 451/901] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:52:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:52:04.258317 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa5255-98ce-4a35-9bc1-341b641cbaab None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:52:04.262018 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:52:04.357144 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa5255-98ce-4a35-9bc1-341b641cbaab None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:52:04.389268 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ad433-922c-46e2-954d-28c4fec10ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:52:04.390372 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ad433-922c-46e2-954d-28c4fec10ba1 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:04.390647 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ad433-922c-46e2-954d-28c4fec10ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:04.390913 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ad433-922c-46e2-954d-28c4fec10ba1 None admin] PATH_INFO: `/v3/users` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:04.391623 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ad433-922c-46e2-954d-28c4fec10ba1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:52:04.391924 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ad433-922c-46e2-954d-28c4fec10ba1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:52:04.393471 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ad433-922c-46e2-954d-28c4fec10ba1 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:52:04.411507 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 451/902] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Sep 21 11:52:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:52:04.417200 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253c76b-2b90-4df4-9ff3-e8ca91ce916d None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:52:04.499572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:52:04.514325 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253c76b-2b90-4df4-9ff3-e8ca91ce916d None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:52:04.547312 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220efd0-8929-4361-8c93-798a0364ef40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:52:04.547899 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220efd0-8929-4361-8c93-798a0364ef40 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:04.548203 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220efd0-8929-4361-8c93-798a0364ef40 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:04.548475 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220efd0-8929-4361-8c93-798a0364ef40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:04.613942 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220efd0-8929-4361-8c93-798a0364ef40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:52:04.615326 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220efd0-8929-4361-8c93-798a0364ef40 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:52:04.695408 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:52:04.710822 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 452/903] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 11:52:04 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 11:52:04.716539 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ad433-922c-46e2-954d-28c4fec10ba1 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:52:04.775285 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:52:04.813550 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ad433-922c-46e2-954d-28c4fec10ba1 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:52:04.846058 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab0c40b-7a1d-40c9-8b32-46f095c24f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:52:04.846656 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0c40b-7a1d-40c9-8b32-46f095c24f2c None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:04.846929 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0c40b-7a1d-40c9-8b32-46f095c24f2c None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:04.847192 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0c40b-7a1d-40c9-8b32-46f095c24f2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:04.856656 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab0c40b-7a1d-40c9-8b32-46f095c24f2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:52:04.858078 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab0c40b-7a1d-40c9-8b32-46f095c24f2c None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:52:04.872584 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-4ab0c40b-7a1d-40c9-8b32-46f095c24f2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:52:04.872584 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:52:04.872584 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:52:04.872584 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:52:04.872584 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:52:04.872584 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:52:04.872584 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:52:04.872584 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:52:04.872584 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:52:04.872584 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:52:04.872584 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:52:04.872584 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:52:04.872584 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 11:52:04.872584 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 11:52:04.872584 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 11:52:04.872584 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 11:52:04.873791 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:52:04.873791 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:52:04.873791 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:52:04.873791 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:52:04.873791 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:52:04.873791 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:52:04.873791 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:52:04.873791 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:52:04.873791 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:52:04.873791 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:52:04.873791 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:52:04.873791 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:52:04.873791 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:52:04.873791 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:52:04.873791 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:52:04.873791 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:52:04.873791 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 11:52:04.874722 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 11:52:04.874722 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 11:52:04.874722 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:52:04.874722 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 452/904] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:52:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:52:04.879453 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220efd0-8929-4361-8c93-798a0364ef40 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:52:04.974622 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220efd0-8929-4361-8c93-798a0364ef40 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:52:05.006683 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e9122-13e0-4bcc-8a6c-a505e6594d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:52:05.007279 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e9122-13e0-4bcc-8a6c-a505e6594d4f None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:05.007554 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e9122-13e0-4bcc-8a6c-a505e6594d4f None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:05.007823 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e9122-13e0-4bcc-8a6c-a505e6594d4f None admin] PATH_INFO: `/v3/domains` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:05.008481 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e9122-13e0-4bcc-8a6c-a505e6594d4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:52:05.008779 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e9122-13e0-4bcc-8a6c-a505e6594d4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:52:05.010131 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e9122-13e0-4bcc-8a6c-a505e6594d4f None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:52:05.021478 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 453/905] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 11:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:52:05.027347 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab0c40b-7a1d-40c9-8b32-46f095c24f2c None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:52:05.122938 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab0c40b-7a1d-40c9-8b32-46f095c24f2c None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:52:05.135646 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:52:05.156555 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63b779-643a-439c-ba11-a4dfd49a9a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:52:05.157478 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63b779-643a-439c-ba11-a4dfd49a9a65 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:05.157756 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63b779-643a-439c-ba11-a4dfd49a9a65 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:05.158021 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63b779-643a-439c-ba11-a4dfd49a9a65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:05.164669 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63b779-643a-439c-ba11-a4dfd49a9a65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:52:05.166097 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63b779-643a-439c-ba11-a4dfd49a9a65 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:52:05.176980 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application [None req-ca63b779-643a-439c-ba11-a4dfd49a9a65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:52:05.176980 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:52:05.176980 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:52:05.176980 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:52:05.176980 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:52:05.176980 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:52:05.176980 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:52:05.176980 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:52:05.176980 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:52:05.176980 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:52:05.176980 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:52:05.176980 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:52:05.176980 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 11:52:05.176980 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 11:52:05.176980 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 11:52:05.177981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 11:52:05.177981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:52:05.177981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:52:05.177981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:52:05.177981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:52:05.177981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:52:05.177981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:52:05.177981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:52:05.177981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application with Lock( Sep 21 11:52:05.177981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:52:05.177981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:52:05.177981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:52:05.177981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:52:05.177981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:52:05.177981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:52:05.177981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:52:05.177981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:52:05.179042 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 11:52:05.179042 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 11:52:05.179042 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 11:52:05.179042 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 11:52:05.179042 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 11:52:05.179042 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 11:52:05.179042 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 11:52:05.179042 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: ERROR keystone.server.flask.application Sep 21 11:52:05.179042 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 453/906] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 11:52:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:52:05.184639 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e9122-13e0-4bcc-8a6c-a505e6594d4f None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:52:05.229783 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:52:05.283482 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e9122-13e0-4bcc-8a6c-a505e6594d4f None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:52:05.314784 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5919b735-d405-432b-b159-9ba7fed7fa80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:52:05.315370 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919b735-d405-432b-b159-9ba7fed7fa80 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:05.315641 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919b735-d405-432b-b159-9ba7fed7fa80 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:05.315905 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919b735-d405-432b-b159-9ba7fed7fa80 None admin] PATH_INFO: `/v3/projects` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:05.316635 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5919b735-d405-432b-b159-9ba7fed7fa80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:52:05.316932 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5919b735-d405-432b-b159-9ba7fed7fa80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:52:05.318328 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5919b735-d405-432b-b159-9ba7fed7fa80 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:52:05.330766 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 454/907] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 11:52:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:52:05.336923 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63b779-643a-439c-ba11-a4dfd49a9a65 None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:52:05.433494 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63b779-643a-439c-ba11-a4dfd49a9a65 None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:52:05.465867 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ced61-cf49-478a-9c31-16bd9e3f8eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:52:05.466445 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ced61-cf49-478a-9c31-16bd9e3f8eec None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:05.466714 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ced61-cf49-478a-9c31-16bd9e3f8eec None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:05.466980 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ced61-cf49-478a-9c31-16bd9e3f8eec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:05.467677 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ced61-cf49-478a-9c31-16bd9e3f8eec None admin] RBAC: Adding query filter params (role.id=d1f3d1431da145709a5e9b374f3b403d, scope.project.id=1fd87b195f7c46d2a0d621124acce331, user.id=c58b4f9b474c492984a08198cb7df0a0) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:52:05.468529 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ced61-cf49-478a-9c31-16bd9e3f8eec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:52:05.469939 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ced61-cf49-478a-9c31-16bd9e3f8eec None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:52:05.475435 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 454/908] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 11:52:05 2022] GET /identity/v3/role_assignments?user.id=c58b4f9b474c492984a08198cb7df0a0&scope.project.id=1fd87b195f7c46d2a0d621124acce331&role.id=d1f3d1431da145709a5e9b374f3b403d => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:52:07.872608 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b11be-1f5a-45a4-a535-b17b41d28b1b None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:07.873132 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b11be-1f5a-45a4-a535-b17b41d28b1b None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:07.873132 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b11be-1f5a-45a4-a535-b17b41d28b1b None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:07.874915 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 455/909] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:52:07.880184 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33768a38-2a66-4369-8a75-d4ee49597204 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:07.880595 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33768a38-2a66-4369-8a75-d4ee49597204 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:07.880731 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33768a38-2a66-4369-8a75-d4ee49597204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:07.900938 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-33768a38-2a66-4369-8a75-d4ee49597204 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:52:07.902501 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-33768a38-2a66-4369-8a75-d4ee49597204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:52:07.934998 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:52:07.972368 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 455/910] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:52:07 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 11:52:08.302781 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b11be-1f5a-45a4-a535-b17b41d28b1b None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:52:08.404890 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b11be-1f5a-45a4-a535-b17b41d28b1b None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:52:08.412551 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:52:08.438277 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c62195-822f-424d-a9ed-8e1767bdda3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:52:08.438883 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c62195-822f-424d-a9ed-8e1767bdda3a None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:08.439153 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c62195-822f-424d-a9ed-8e1767bdda3a None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:08.439417 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c62195-822f-424d-a9ed-8e1767bdda3a None admin] PATH_INFO: `/v3/services/placement` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:08.440069 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c62195-822f-424d-a9ed-8e1767bdda3a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:52:08.441348 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c62195-822f-424d-a9ed-8e1767bdda3a None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:52:08.449678 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-48c62195-822f-424d-a9ed-8e1767bdda3a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 11:52:08.449678 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:52:08.449678 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 11:52:08.449678 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 11:52:08.449678 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 11:52:08.449678 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 11:52:08.449678 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 11:52:08.449678 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:52:08.449678 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 11:52:08.449678 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:52:08.449678 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 11:52:08.449678 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:52:08.449678 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:52:08.449678 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:52:08.449678 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:52:08.449678 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:52:08.449678 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:52:08.450993 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:52:08.450993 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:52:08.450993 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:52:08.450993 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:52:08.450993 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:52:08.450993 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:52:08.450993 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 11:52:08.450993 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 11:52:08.450993 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 11:52:08.450993 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 11:52:08.450993 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:52:08.450993 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:52:08.450993 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:52:08.450993 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:52:08.450993 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:52:08.450993 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:52:08.452327 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:52:08.452327 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:52:08.452327 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:52:08.452327 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:52:08.452327 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:52:08.452327 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:52:08.452327 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:52:08.452327 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:52:08.452327 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:52:08.452327 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:52:08.452327 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 11:52:08.452327 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:52:08.452327 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 11:52:08.452327 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:52:08.452327 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 456/911] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Sep 21 11:52:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:52:08.456810 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33768a38-2a66-4369-8a75-d4ee49597204 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:52:08.551078 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33768a38-2a66-4369-8a75-d4ee49597204 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:52:08.589273 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb59d1-363a-4223-a802-b74688254ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:52:08.589872 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb59d1-363a-4223-a802-b74688254ac5 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:08.590141 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb59d1-363a-4223-a802-b74688254ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:08.590403 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb59d1-363a-4223-a802-b74688254ac5 None admin] PATH_INFO: `/v3/services` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:08.591021 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb59d1-363a-4223-a802-b74688254ac5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:52:08.591315 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb59d1-363a-4223-a802-b74688254ac5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:52:08.592724 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb59d1-363a-4223-a802-b74688254ac5 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:52:08.597879 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 456/912] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Sep 21 11:52:08 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:52:08.603763 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c62195-822f-424d-a9ed-8e1767bdda3a None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:52:08.699645 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c62195-822f-424d-a9ed-8e1767bdda3a None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:52:08.732110 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38da6a0-b4ce-4e06-a300-24709469dc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:52:08.732691 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38da6a0-b4ce-4e06-a300-24709469dc64 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:08.732955 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38da6a0-b4ce-4e06-a300-24709469dc64 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:08.733222 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38da6a0-b4ce-4e06-a300-24709469dc64 None admin] PATH_INFO: `/v3/services` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:08.733867 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38da6a0-b4ce-4e06-a300-24709469dc64 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:52:08.734162 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38da6a0-b4ce-4e06-a300-24709469dc64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:52:08.735585 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38da6a0-b4ce-4e06-a300-24709469dc64 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:52:08.739831 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 457/913] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Sep 21 11:52:08 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:52:11.091673 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97ca59-2ad4-4948-8fcb-54e4f7b7d2be None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:11.092301 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97ca59-2ad4-4948-8fcb-54e4f7b7d2be None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:11.092301 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97ca59-2ad4-4948-8fcb-54e4f7b7d2be None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:11.093604 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 457/914] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:52:11.098890 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa2488-bcd7-4968-9516-4fa43c77b568 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:11.099345 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa2488-bcd7-4968-9516-4fa43c77b568 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:11.099447 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa2488-bcd7-4968-9516-4fa43c77b568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:11.117571 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-1daa2488-bcd7-4968-9516-4fa43c77b568 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:52:11.118734 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-1daa2488-bcd7-4968-9516-4fa43c77b568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:52:11.144647 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:52:11.184510 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 458/915] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:52:11 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 11:52:11.522448 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97ca59-2ad4-4948-8fcb-54e4f7b7d2be None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:52:11.555442 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:52:11.626191 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97ca59-2ad4-4948-8fcb-54e4f7b7d2be None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:52:11.659093 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ddb73-dd96-425e-9b6f-d5380a0f4bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:52:11.659678 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ddb73-dd96-425e-9b6f-d5380a0f4bbc None admin] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:11.659945 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ddb73-dd96-425e-9b6f-d5380a0f4bbc None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:11.660258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ddb73-dd96-425e-9b6f-d5380a0f4bbc None admin] PATH_INFO: `/v3/services` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:11.661132 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ddb73-dd96-425e-9b6f-d5380a0f4bbc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:52:11.662468 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ddb73-dd96-425e-9b6f-d5380a0f4bbc None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:52:11.676802 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 458/916] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 21 11:52:11 2022] POST /identity/v3/services => generated 246 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 11:52:14.028662 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a67b4-3a95-4f8f-938c-940abb3430cd None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:14.029225 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a67b4-3a95-4f8f-938c-940abb3430cd None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:14.029225 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a67b4-3a95-4f8f-938c-940abb3430cd None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:14.030532 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 459/917] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:52:14.035833 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ca1bd-06f5-4eac-9360-272c4682ea71 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:14.036302 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ca1bd-06f5-4eac-9360-272c4682ea71 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:14.036403 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ca1bd-06f5-4eac-9360-272c4682ea71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:14.054885 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-109ca1bd-06f5-4eac-9360-272c4682ea71 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:52:14.056099 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-109ca1bd-06f5-4eac-9360-272c4682ea71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:52:14.125999 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 459/918] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:52:14 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 11:52:14.443521 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a67b4-3a95-4f8f-938c-940abb3430cd None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:52:14.539489 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a67b4-3a95-4f8f-938c-940abb3430cd None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:52:14.571341 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fd9f9-3aad-4578-ba3d-27d7ea665769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:52:14.571943 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fd9f9-3aad-4578-ba3d-27d7ea665769 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:14.572244 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fd9f9-3aad-4578-ba3d-27d7ea665769 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:14.572504 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fd9f9-3aad-4578-ba3d-27d7ea665769 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:14.573069 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01fd9f9-3aad-4578-ba3d-27d7ea665769 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:52:14.574409 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01fd9f9-3aad-4578-ba3d-27d7ea665769 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:52:14.583047 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-d01fd9f9-3aad-4578-ba3d-27d7ea665769 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 11:52:14.583047 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:52:14.583047 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 11:52:14.583047 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 11:52:14.583047 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 11:52:14.583047 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 11:52:14.583047 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 11:52:14.583047 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:52:14.583047 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 11:52:14.583047 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:52:14.583047 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 11:52:14.583047 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:52:14.583047 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:52:14.583047 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:52:14.583047 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:52:14.583047 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:52:14.583047 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:52:14.584372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:52:14.584372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:52:14.584372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:52:14.584372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:52:14.584372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:52:14.584372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:52:14.584372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 11:52:14.584372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 11:52:14.584372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 11:52:14.584372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 11:52:14.584372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:52:14.584372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:52:14.584372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:52:14.584372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:52:14.584372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:52:14.584372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:52:14.585353 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:52:14.585353 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:52:14.585353 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:52:14.585353 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:52:14.585353 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:52:14.585353 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:52:14.585353 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:52:14.585353 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:52:14.585353 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:52:14.585353 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:52:14.585353 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 11:52:14.585353 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:52:14.585353 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 11:52:14.585353 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:52:14.586705 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 460/919] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Sep 21 11:52:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 11:52:14.589984 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ca1bd-06f5-4eac-9360-272c4682ea71 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:52:14.608154 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:52:14.685904 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ca1bd-06f5-4eac-9360-272c4682ea71 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:52:14.718998 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27310c44-e7fb-464e-b1c0-698aa708fb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:52:14.719523 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27310c44-e7fb-464e-b1c0-698aa708fb7a None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:14.719792 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27310c44-e7fb-464e-b1c0-698aa708fb7a None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:14.720082 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27310c44-e7fb-464e-b1c0-698aa708fb7a None admin] PATH_INFO: `/v3/services` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:14.720695 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27310c44-e7fb-464e-b1c0-698aa708fb7a None admin] RBAC: Adding query filter params (name=placement) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:52:14.720993 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27310c44-e7fb-464e-b1c0-698aa708fb7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:52:14.722340 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27310c44-e7fb-464e-b1c0-698aa708fb7a None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:52:14.727138 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 460/920] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Sep 21 11:52:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:52:14.732976 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fd9f9-3aad-4578-ba3d-27d7ea665769 None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:52:14.760363 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:52:14.828714 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fd9f9-3aad-4578-ba3d-27d7ea665769 None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:52:14.860277 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731d0b7-2f50-4f4f-8a5c-f5d4723aa9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:52:14.860852 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731d0b7-2f50-4f4f-8a5c-f5d4723aa9b7 None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:14.861123 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731d0b7-2f50-4f4f-8a5c-f5d4723aa9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:14.861387 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731d0b7-2f50-4f4f-8a5c-f5d4723aa9b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:14.862067 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731d0b7-2f50-4f4f-8a5c-f5d4723aa9b7 None admin] RBAC: Adding query filter params (interface=public, service_id=e9089f88ee5542bebed2f74cbdc55a28, region_id=RegionOne) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:52:14.862363 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731d0b7-2f50-4f4f-8a5c-f5d4723aa9b7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:52:14.863701 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731d0b7-2f50-4f4f-8a5c-f5d4723aa9b7 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:52:14.868468 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 461/921] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Sep 21 11:52:14 2022] GET /identity/v3/endpoints?service_id=e9089f88ee5542bebed2f74cbdc55a28&interface=public®ion_id=RegionOne => generated 194 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:52:14.874154 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27310c44-e7fb-464e-b1c0-698aa708fb7a None admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:52:14.954264 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:52:14.972860 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27310c44-e7fb-464e-b1c0-698aa708fb7a None admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:52:15.005916 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a91f7-a3e3-4a91-95ee-2ff8cf4856f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:52:15.006502 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a91f7-a3e3-4a91-95ee-2ff8cf4856f4 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:15.006774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a91f7-a3e3-4a91-95ee-2ff8cf4856f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:15.007039 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a91f7-a3e3-4a91-95ee-2ff8cf4856f4 None admin] PATH_INFO: `/v3/services` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:15.007625 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a91f7-a3e3-4a91-95ee-2ff8cf4856f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:52:15.009011 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a91f7-a3e3-4a91-95ee-2ff8cf4856f4 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:52:15.015800 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 461/922] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 21 11:52:14 2022] GET /identity/v3/services => generated 1962 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 11:52:17.357448 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36552f5f-e9e1-47f5-a12b-f18794e0437d None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:17.358014 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36552f5f-e9e1-47f5-a12b-f18794e0437d None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:17.358014 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36552f5f-e9e1-47f5-a12b-f18794e0437d None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:17.359302 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 462/923] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:52:17.364535 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb985103-6230-4b58-9ae5-fa06b7120ef8 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:17.364911 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb985103-6230-4b58-9ae5-fa06b7120ef8 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:17.365067 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb985103-6230-4b58-9ae5-fa06b7120ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:17.383068 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-bb985103-6230-4b58-9ae5-fa06b7120ef8 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:52:17.384249 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-bb985103-6230-4b58-9ae5-fa06b7120ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:52:17.449289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 462/924] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:52:17 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 11:52:17.769129 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36552f5f-e9e1-47f5-a12b-f18794e0437d None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:52:17.859140 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:52:17.868652 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36552f5f-e9e1-47f5-a12b-f18794e0437d None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:52:17.901390 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44b6d6-15b7-4089-80a9-027977c4d1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:52:17.902009 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44b6d6-15b7-4089-80a9-027977c4d1ac None admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:17.902278 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44b6d6-15b7-4089-80a9-027977c4d1ac None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:17.902546 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44b6d6-15b7-4089-80a9-027977c4d1ac None admin] PATH_INFO: `/v3/services/placement` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:17.903114 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44b6d6-15b7-4089-80a9-027977c4d1ac None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:52:17.904498 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44b6d6-15b7-4089-80a9-027977c4d1ac None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:52:17.914182 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application [None req-8a44b6d6-15b7-4089-80a9-027977c4d1ac None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 11:52:17.914182 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:52:17.914182 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 11:52:17.914182 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 11:52:17.914182 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 11:52:17.914182 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 11:52:17.914182 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 11:52:17.914182 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:52:17.914182 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 11:52:17.914182 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:52:17.914182 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 11:52:17.914182 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:52:17.914182 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 11:52:17.914182 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 11:52:17.914182 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 11:52:17.914182 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 11:52:17.914182 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 11:52:17.915472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 11:52:17.915472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 11:52:17.915472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 11:52:17.915472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 11:52:17.915472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 11:52:17.915472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 11:52:17.915472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 11:52:17.915472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 11:52:17.915472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 11:52:17.915472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 11:52:17.915472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 11:52:17.915472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 11:52:17.915472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 11:52:17.915472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 11:52:17.915472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 11:52:17.915472 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 11:52:17.916572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 11:52:17.916572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application with Lock( Sep 21 11:52:17.916572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 11:52:17.916572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self._enter() Sep 21 11:52:17.916572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 11:52:17.916572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 11:52:17.916572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 11:52:17.916572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application return self.creator() Sep 21 11:52:17.916572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 11:52:17.916572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application created_value = creator( Sep 21 11:52:17.916572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 11:52:17.916572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 11:52:17.916572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 11:52:17.916572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: ERROR keystone.server.flask.application Sep 21 11:52:17.916572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 463/925] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Sep 21 11:52:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 11:52:17.921188 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb985103-6230-4b58-9ae5-fa06b7120ef8 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:52:17.994550 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:52:18.017304 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb985103-6230-4b58-9ae5-fa06b7120ef8 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:52:18.051049 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca8cd3-93fa-4944-bd93-e1046d63f524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:52:18.051571 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca8cd3-93fa-4944-bd93-e1046d63f524 None admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:18.051845 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca8cd3-93fa-4944-bd93-e1046d63f524 None admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:18.052149 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca8cd3-93fa-4944-bd93-e1046d63f524 None admin] PATH_INFO: `/v3/services` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:18.052769 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca8cd3-93fa-4944-bd93-e1046d63f524 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:52:18.053069 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca8cd3-93fa-4944-bd93-e1046d63f524 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:52:18.054432 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca8cd3-93fa-4944-bd93-e1046d63f524 None admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:52:18.059303 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 463/926] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Sep 21 11:52:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:52:18.064946 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44b6d6-15b7-4089-80a9-027977c4d1ac None admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:52:18.160202 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44b6d6-15b7-4089-80a9-027977c4d1ac None admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:52:18.193439 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc386905-d4f4-41d9-a1fc-494acf052ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:52:18.194022 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc386905-d4f4-41d9-a1fc-494acf052ea0 None admin] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:52:18.194297 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc386905-d4f4-41d9-a1fc-494acf052ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:52:18.194566 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc386905-d4f4-41d9-a1fc-494acf052ea0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:52:18.195217 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc386905-d4f4-41d9-a1fc-494acf052ea0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:52:18.196597 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc386905-d4f4-41d9-a1fc-494acf052ea0 None admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:52:18.215416 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 464/927] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 11:52:18 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 11:52:28.056702 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=30 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:52:28.211433 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:53:17.934421 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e4858-1860-4e84-ac27-ca3d87a3cb4b None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:17.935025 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e4858-1860-4e84-ac27-ca3d87a3cb4b None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:17.935025 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e4858-1860-4e84-ac27-ca3d87a3cb4b None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:17.940855 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 464/928] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:53:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:53:17.942911 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cde8e-f708-417a-b1b1-dbe1327a2a61 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:17.943350 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cde8e-f708-417a-b1b1-dbe1327a2a61 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:17.943443 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cde8e-f708-417a-b1b1-dbe1327a2a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:17.969127 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-7b9cde8e-f708-417a-b1b1-dbe1327a2a61 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:53:17.972888 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-7b9cde8e-f708-417a-b1b1-dbe1327a2a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:53:18.082086 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 465/929] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:53:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:53:18.439320 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563232e-01b7-43d4-9b70-0ea582e8372d None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:18.439611 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563232e-01b7-43d4-9b70-0ea582e8372d None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:18.439887 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563232e-01b7-43d4-9b70-0ea582e8372d None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:18.441250 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 465/930] 10.222.0.27 () {54 vars in 963 bytes} [Wed Sep 21 11:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:53:18.447298 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02799378-6eb3-404e-b206-47aac1a90992 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:18.447692 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02799378-6eb3-404e-b206-47aac1a90992 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:18.448015 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02799378-6eb3-404e-b206-47aac1a90992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:18.509853 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-02799378-6eb3-404e-b206-47aac1a90992 None None] MFA Rules not processed for user `1cf371d784014c68a9ff4c301dad5ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:53:18.511078 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-02799378-6eb3-404e-b206-47aac1a90992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:53:18.589383 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 466/931] 10.222.0.27 () {58 vars in 1060 bytes} [Wed Sep 21 11:53:18 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:53:18.599112 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563232e-01b7-43d4-9b70-0ea582e8372d None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:53:18.609612 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563232e-01b7-43d4-9b70-0ea582e8372d None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:53:18.612990 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a7ac2-f8a7-47dc-acda-53b93de69bcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:53:18.613878 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a7ac2-f8a7-47dc-acda-53b93de69bcd service neutron] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:18.614133 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a7ac2-f8a7-47dc-acda-53b93de69bcd service neutron] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:18.614392 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a7ac2-f8a7-47dc-acda-53b93de69bcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:18.623159 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a7ac2-f8a7-47dc-acda-53b93de69bcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:53:18.624607 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a7ac2-f8a7-47dc-acda-53b93de69bcd service neutron] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:53:18.633793 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 466/932] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:53:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:53:21.307226 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5faa2-4e0d-4160-9474-d44dfaa94d5a None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:21.307772 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5faa2-4e0d-4160-9474-d44dfaa94d5a None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:21.307772 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5faa2-4e0d-4160-9474-d44dfaa94d5a None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:21.309142 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 467/933] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:53:21.315553 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1aee97-6344-4b36-96bf-54eb18b428d0 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:21.316116 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1aee97-6344-4b36-96bf-54eb18b428d0 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:21.316116 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1aee97-6344-4b36-96bf-54eb18b428d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:21.336587 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-5f1aee97-6344-4b36-96bf-54eb18b428d0 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:53:21.337801 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-5f1aee97-6344-4b36-96bf-54eb18b428d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:53:21.345628 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 467/934] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:53:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:53:21.693511 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29b193-9599-45fe-9acc-bdce7353b47f None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:21.693883 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29b193-9599-45fe-9acc-bdce7353b47f None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:21.694225 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29b193-9599-45fe-9acc-bdce7353b47f None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:21.695688 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 468/935] 10.222.0.27 () {54 vars in 963 bytes} [Wed Sep 21 11:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:53:21.702211 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25993fc-478a-4a70-92a1-f456e4c84944 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:21.702493 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25993fc-478a-4a70-92a1-f456e4c84944 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:21.702785 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25993fc-478a-4a70-92a1-f456e4c84944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:21.722413 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-c25993fc-478a-4a70-92a1-f456e4c84944 None None] MFA Rules not processed for user `1cf371d784014c68a9ff4c301dad5ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:53:21.723586 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-c25993fc-478a-4a70-92a1-f456e4c84944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:53:21.729872 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 468/936] 10.222.0.27 () {58 vars in 1060 bytes} [Wed Sep 21 11:53:21 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:53:21.738766 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29b193-9599-45fe-9acc-bdce7353b47f None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:53:21.749781 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29b193-9599-45fe-9acc-bdce7353b47f None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:53:21.753368 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b244a8d-339c-422f-a788-77a233c3c301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:53:21.753982 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b244a8d-339c-422f-a788-77a233c3c301 service neutron] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:21.754257 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b244a8d-339c-422f-a788-77a233c3c301 service neutron] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:21.754522 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b244a8d-339c-422f-a788-77a233c3c301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:21.764828 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b244a8d-339c-422f-a788-77a233c3c301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:53:21.766286 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b244a8d-339c-422f-a788-77a233c3c301 service neutron] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:53:21.776683 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 469/937] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:53:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:53:24.728737 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a293c1-940f-403c-b252-624978859762 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:24.729308 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a293c1-940f-403c-b252-624978859762 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:24.729308 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a293c1-940f-403c-b252-624978859762 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:24.730832 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 469/938] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:53:24.736522 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac799d6-49d8-4860-83bc-8d5e35e203d6 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:24.737054 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac799d6-49d8-4860-83bc-8d5e35e203d6 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:24.737054 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac799d6-49d8-4860-83bc-8d5e35e203d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:24.778713 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-4ac799d6-49d8-4860-83bc-8d5e35e203d6 None None] MFA Rules not processed for user `955fb91fe1bc4272b566b64ee4527121`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:53:24.780681 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-4ac799d6-49d8-4860-83bc-8d5e35e203d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:53:24.832528 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:53:24.868257 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 470/939] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:53:24 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:53:25.207727 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a293c1-940f-403c-b252-624978859762 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:53:25.218378 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a293c1-940f-403c-b252-624978859762 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:53:25.221814 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b85922-2904-402b-8479-0b4b9fe9a329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:53:25.222395 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b85922-2904-402b-8479-0b4b9fe9a329 service neutron] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:25.222664 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b85922-2904-402b-8479-0b4b9fe9a329 service neutron] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:25.222927 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b85922-2904-402b-8479-0b4b9fe9a329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:25.231727 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b85922-2904-402b-8479-0b4b9fe9a329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:53:25.233717 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b85922-2904-402b-8479-0b4b9fe9a329 service neutron] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:53:25.243121 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 470/940] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:53:25 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:53:28.365028 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa162b-f4f4-44c1-987b-9d7266106565 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:28.365551 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa162b-f4f4-44c1-987b-9d7266106565 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:28.365551 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa162b-f4f4-44c1-987b-9d7266106565 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:28.366804 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 471/941] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:53:28.371945 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b0207-6d31-49c0-81b4-d467e22fdd5c None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:28.372391 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b0207-6d31-49c0-81b4-d467e22fdd5c None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:28.372501 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b0207-6d31-49c0-81b4-d467e22fdd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:28.391604 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-426b0207-6d31-49c0-81b4-d467e22fdd5c None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:53:28.392814 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-426b0207-6d31-49c0-81b4-d467e22fdd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:53:28.457154 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 471/942] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:53:28 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:53:28.798550 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa162b-f4f4-44c1-987b-9d7266106565 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:53:28.808998 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa162b-f4f4-44c1-987b-9d7266106565 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:53:28.812898 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38391f99-e9c7-401f-a9f9-7c9206979dd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:53:28.813473 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38391f99-e9c7-401f-a9f9-7c9206979dd2 service neutron] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:28.813774 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38391f99-e9c7-401f-a9f9-7c9206979dd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:28.814043 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38391f99-e9c7-401f-a9f9-7c9206979dd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:28.822587 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38391f99-e9c7-401f-a9f9-7c9206979dd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:53:28.824008 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38391f99-e9c7-401f-a9f9-7c9206979dd2 service neutron] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:53:28.833650 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 472/943] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:53:28 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:53:31.923278 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecdb6d-2e1d-4399-84d7-f3b9f4f89d79 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:31.923840 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecdb6d-2e1d-4399-84d7-f3b9f4f89d79 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:31.923840 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecdb6d-2e1d-4399-84d7-f3b9f4f89d79 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:31.925173 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 472/944] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:53:31.930397 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef626a-9538-42ab-b9ff-d27d4c2b0a7c None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:31.930853 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef626a-9538-42ab-b9ff-d27d4c2b0a7c None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:31.930949 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef626a-9538-42ab-b9ff-d27d4c2b0a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:31.950124 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-89ef626a-9538-42ab-b9ff-d27d4c2b0a7c None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:53:31.952565 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-89ef626a-9538-42ab-b9ff-d27d4c2b0a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:53:31.960856 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 473/945] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:53:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 11:53:32.307772 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ecdb6d-2e1d-4399-84d7-f3b9f4f89d79 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:53:32.318769 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ecdb6d-2e1d-4399-84d7-f3b9f4f89d79 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:53:32.322249 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d02728-891e-4e84-991c-1ca4af7ceba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:53:32.322898 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d02728-891e-4e84-991c-1ca4af7ceba2 service neutron] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:32.323236 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d02728-891e-4e84-991c-1ca4af7ceba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:32.323569 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d02728-891e-4e84-991c-1ca4af7ceba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:32.333121 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d02728-891e-4e84-991c-1ca4af7ceba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:53:32.334639 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d02728-891e-4e84-991c-1ca4af7ceba2 service neutron] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:53:32.344631 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 473/946] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:53:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:53:34.807205 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06618f3b-3f1d-4eff-b84d-9df972e37449 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:34.807755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06618f3b-3f1d-4eff-b84d-9df972e37449 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:34.807755 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06618f3b-3f1d-4eff-b84d-9df972e37449 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:34.809082 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 474/947] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:53:34.814205 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3b2f2-d7d8-4b6f-a8ce-225783b2d9d9 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:34.814635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3b2f2-d7d8-4b6f-a8ce-225783b2d9d9 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:34.814729 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3b2f2-d7d8-4b6f-a8ce-225783b2d9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:34.833403 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-dbf3b2f2-d7d8-4b6f-a8ce-225783b2d9d9 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:53:34.834597 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-dbf3b2f2-d7d8-4b6f-a8ce-225783b2d9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:53:34.842721 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 474/948] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:53:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:53:35.182723 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06618f3b-3f1d-4eff-b84d-9df972e37449 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:53:35.193833 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06618f3b-3f1d-4eff-b84d-9df972e37449 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:53:35.197488 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0742c-fafd-410d-8613-438290793977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:53:35.198078 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0742c-fafd-410d-8613-438290793977 service neutron] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:35.198355 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0742c-fafd-410d-8613-438290793977 service neutron] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:35.198716 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0742c-fafd-410d-8613-438290793977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:35.207653 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0742c-fafd-410d-8613-438290793977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:53:35.209138 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0742c-fafd-410d-8613-438290793977 service neutron] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:53:35.218529 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 475/949] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:53:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:53:37.660366 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b3368-ebcb-49e2-80d6-959d11e75180 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:37.660904 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b3368-ebcb-49e2-80d6-959d11e75180 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:37.660904 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b3368-ebcb-49e2-80d6-959d11e75180 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:37.662486 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 475/950] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:53:37.667553 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d711d63-4ce1-4b63-9d42-3b8cd74f0deb None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:37.667943 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d711d63-4ce1-4b63-9d42-3b8cd74f0deb None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:37.668120 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d711d63-4ce1-4b63-9d42-3b8cd74f0deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:37.687136 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-3d711d63-4ce1-4b63-9d42-3b8cd74f0deb None None] MFA Rules not processed for user `955fb91fe1bc4272b566b64ee4527121`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:53:37.688400 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-3d711d63-4ce1-4b63-9d42-3b8cd74f0deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:53:37.696031 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 476/951] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:53:37 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 11:53:38.028383 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b3368-ebcb-49e2-80d6-959d11e75180 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:53:38.039814 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b3368-ebcb-49e2-80d6-959d11e75180 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:53:38.043313 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960133d-96d8-4271-a19e-3d4a34f69ad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:53:38.043888 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960133d-96d8-4271-a19e-3d4a34f69ad6 service neutron] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:38.044181 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960133d-96d8-4271-a19e-3d4a34f69ad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:38.044444 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960133d-96d8-4271-a19e-3d4a34f69ad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:38.053178 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960133d-96d8-4271-a19e-3d4a34f69ad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:53:38.054597 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960133d-96d8-4271-a19e-3d4a34f69ad6 service neutron] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:53:38.063727 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 476/952] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:53:38 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:53:40.682264 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f3a6a-097f-408c-8c56-de53ea5960e1 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:40.682820 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f3a6a-097f-408c-8c56-de53ea5960e1 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:40.682820 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f3a6a-097f-408c-8c56-de53ea5960e1 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:40.684148 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 477/953] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:53:40.689963 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02612b22-f019-438f-a311-8208d79a1294 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:40.690416 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02612b22-f019-438f-a311-8208d79a1294 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:40.690520 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02612b22-f019-438f-a311-8208d79a1294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:40.710825 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-02612b22-f019-438f-a311-8208d79a1294 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:53:40.712105 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-02612b22-f019-438f-a311-8208d79a1294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:53:40.719826 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 477/954] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:53:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:53:41.055178 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f3a6a-097f-408c-8c56-de53ea5960e1 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:53:41.066070 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f3a6a-097f-408c-8c56-de53ea5960e1 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:53:41.069478 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ce89c-e022-41b9-bb02-c1363a23fc4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:53:41.070053 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ce89c-e022-41b9-bb02-c1363a23fc4d service neutron] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:41.070323 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ce89c-e022-41b9-bb02-c1363a23fc4d service neutron] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:41.070587 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ce89c-e022-41b9-bb02-c1363a23fc4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:41.079613 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ce89c-e022-41b9-bb02-c1363a23fc4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:53:41.081131 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ce89c-e022-41b9-bb02-c1363a23fc4d service neutron] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:53:41.090408 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 478/955] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:53:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:53:43.558142 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269ed0e-4aad-4674-802c-ce9b1e9706f7 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:43.558683 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269ed0e-4aad-4674-802c-ce9b1e9706f7 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:43.558683 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269ed0e-4aad-4674-802c-ce9b1e9706f7 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:43.559934 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 478/956] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:53:43.565111 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fce275-695d-4b60-aaad-bcafa4850cde None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:43.565555 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fce275-695d-4b60-aaad-bcafa4850cde None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:43.565658 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fce275-695d-4b60-aaad-bcafa4850cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:43.585435 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-43fce275-695d-4b60-aaad-bcafa4850cde None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:53:43.586602 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-43fce275-695d-4b60-aaad-bcafa4850cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:53:43.594918 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 479/957] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:53:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:53:43.934239 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269ed0e-4aad-4674-802c-ce9b1e9706f7 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:53:43.945619 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269ed0e-4aad-4674-802c-ce9b1e9706f7 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:53:43.949072 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17400365-e363-4ffc-b7e2-f7782b3cf440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:53:43.949648 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17400365-e363-4ffc-b7e2-f7782b3cf440 service neutron] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:43.949920 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17400365-e363-4ffc-b7e2-f7782b3cf440 service neutron] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:43.950186 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17400365-e363-4ffc-b7e2-f7782b3cf440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:43.959367 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17400365-e363-4ffc-b7e2-f7782b3cf440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:53:43.960821 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17400365-e363-4ffc-b7e2-f7782b3cf440 service neutron] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:53:43.969768 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 479/958] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:53:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:53:46.690010 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6795ff-c356-49df-a563-b2cd9b5e1a93 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:46.690529 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6795ff-c356-49df-a563-b2cd9b5e1a93 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:46.690529 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6795ff-c356-49df-a563-b2cd9b5e1a93 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:46.691886 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 480/959] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:53:46.697143 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f1900-0e6e-441b-8fba-96a992ab7ea3 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:46.697569 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f1900-0e6e-441b-8fba-96a992ab7ea3 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:46.697673 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f1900-0e6e-441b-8fba-96a992ab7ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:46.717168 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-0a3f1900-0e6e-441b-8fba-96a992ab7ea3 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:53:46.718335 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-0a3f1900-0e6e-441b-8fba-96a992ab7ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:53:46.728051 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 480/960] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:53:46 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:53:47.061489 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6795ff-c356-49df-a563-b2cd9b5e1a93 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:53:47.072007 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6795ff-c356-49df-a563-b2cd9b5e1a93 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:53:47.075406 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302067e-a347-4acd-b5af-f2d3d8ab2f0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:53:47.075983 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302067e-a347-4acd-b5af-f2d3d8ab2f0a service neutron] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:47.076800 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302067e-a347-4acd-b5af-f2d3d8ab2f0a service neutron] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:47.077058 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302067e-a347-4acd-b5af-f2d3d8ab2f0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:47.085634 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302067e-a347-4acd-b5af-f2d3d8ab2f0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:53:47.087045 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302067e-a347-4acd-b5af-f2d3d8ab2f0a service neutron] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:53:47.096699 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 481/961] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:53:47 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:53:51.378431 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f4d97-37bf-466e-907a-4b706a28bf92 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:51.378974 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f4d97-37bf-466e-907a-4b706a28bf92 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:51.378974 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f4d97-37bf-466e-907a-4b706a28bf92 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:51.380325 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 481/962] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:53:51.385405 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4adc9-90de-44f5-9b7d-937f24627883 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:51.385824 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4adc9-90de-44f5-9b7d-937f24627883 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:51.385926 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4adc9-90de-44f5-9b7d-937f24627883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:51.405587 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-3ef4adc9-90de-44f5-9b7d-937f24627883 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:53:51.406767 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-3ef4adc9-90de-44f5-9b7d-937f24627883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:53:51.414927 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 482/963] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:53:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:53:51.751319 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f4d97-37bf-466e-907a-4b706a28bf92 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:53:51.756792 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=77 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:53:51.763312 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f4d97-37bf-466e-907a-4b706a28bf92 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:53:51.767392 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd2273-49f9-4d02-97f4-465f7e2d138d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:53:51.767973 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd2273-49f9-4d02-97f4-465f7e2d138d service neutron] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:51.768273 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd2273-49f9-4d02-97f4-465f7e2d138d service neutron] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:51.768536 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd2273-49f9-4d02-97f4-465f7e2d138d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:51.777323 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd2273-49f9-4d02-97f4-465f7e2d138d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:53:51.778741 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd2273-49f9-4d02-97f4-465f7e2d138d service neutron] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:53:51.789007 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 482/964] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:53:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:53:54.807664 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35203fe9-8fce-42b1-9b96-ea3b681725db None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:54.808220 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35203fe9-8fce-42b1-9b96-ea3b681725db None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:54.808220 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35203fe9-8fce-42b1-9b96-ea3b681725db None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:54.809566 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 483/965] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:53:54.814913 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afe1c7-d541-440c-9a77-83ffce763649 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:54.815379 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afe1c7-d541-440c-9a77-83ffce763649 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:54.815470 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afe1c7-d541-440c-9a77-83ffce763649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:54.834798 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-a1afe1c7-d541-440c-9a77-83ffce763649 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:53:54.836046 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-a1afe1c7-d541-440c-9a77-83ffce763649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:53:54.844732 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 483/966] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:53:54 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:53:55.184404 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35203fe9-8fce-42b1-9b96-ea3b681725db None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:53:55.190525 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=48 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:53:55.197105 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35203fe9-8fce-42b1-9b96-ea3b681725db None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:53:55.200517 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce6654-8fd6-479b-af8c-8fef01da725f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:53:55.201672 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce6654-8fd6-479b-af8c-8fef01da725f service neutron] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:55.201957 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce6654-8fd6-479b-af8c-8fef01da725f service neutron] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:55.202223 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce6654-8fd6-479b-af8c-8fef01da725f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:55.211024 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce6654-8fd6-479b-af8c-8fef01da725f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:53:55.212477 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce6654-8fd6-479b-af8c-8fef01da725f service neutron] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:53:55.221628 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 484/967] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:53:55 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:53:59.605127 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215eca64-e4b3-4f6d-b258-b5873df281dd None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:59.605628 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215eca64-e4b3-4f6d-b258-b5873df281dd None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:59.605723 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215eca64-e4b3-4f6d-b258-b5873df281dd None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:59.606992 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 484/968] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:53:59.612286 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a42f8-38f5-4698-8443-a9a7d310ba4e None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:59.612692 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a42f8-38f5-4698-8443-a9a7d310ba4e None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:59.612824 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a42f8-38f5-4698-8443-a9a7d310ba4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:59.632132 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-814a42f8-38f5-4698-8443-a9a7d310ba4e None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:53:59.633312 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-814a42f8-38f5-4698-8443-a9a7d310ba4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:53:59.641801 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 485/969] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:53:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:53:59.971965 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215eca64-e4b3-4f6d-b258-b5873df281dd None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:53:59.983477 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215eca64-e4b3-4f6d-b258-b5873df281dd None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:53:59.986930 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4bdb4-6c1d-4a44-98db-37c63838abca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:53:59.987515 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4bdb4-6c1d-4a44-98db-37c63838abca service neutron] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:53:59.987784 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4bdb4-6c1d-4a44-98db-37c63838abca service neutron] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:53:59.988086 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4bdb4-6c1d-4a44-98db-37c63838abca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:53:59.997048 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e4bdb4-6c1d-4a44-98db-37c63838abca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:53:59.999025 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e4bdb4-6c1d-4a44-98db-37c63838abca service neutron] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:54:00.008086 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 485/970] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:53:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:54:05.520132 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f6ae0-7ca8-4a6c-b77b-22a2024877ec None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:05.520637 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f6ae0-7ca8-4a6c-b77b-22a2024877ec None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:05.520824 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f6ae0-7ca8-4a6c-b77b-22a2024877ec None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:05.522506 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 486/971] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 21 11:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:54:05.536861 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad2ade-36b8-4862-99a0-c53c6ad99f82 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:05.537335 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad2ade-36b8-4862-99a0-c53c6ad99f82 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:05.537600 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad2ade-36b8-4862-99a0-c53c6ad99f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:05.608714 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-34ad2ade-36b8-4862-99a0-c53c6ad99f82 None None] MFA Rules not processed for user `c58b4f9b474c492984a08198cb7df0a0`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:54:05.611539 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-34ad2ade-36b8-4862-99a0-c53c6ad99f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:54:05.712951 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 486/972] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 21 11:54:05 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 11:54:09.627110 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=8 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:54:10.141586 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f440a0-30fd-41dd-9751-88333768b2ad None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:10.142695 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f440a0-30fd-41dd-9751-88333768b2ad None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:10.143429 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f440a0-30fd-41dd-9751-88333768b2ad None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:10.145770 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 487/973] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 21 11:54:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:54:10.150745 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9dd09-34a7-450c-962e-526cb199226a None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:10.151672 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9dd09-34a7-450c-962e-526cb199226a None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:10.152187 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9dd09-34a7-450c-962e-526cb199226a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:10.176198 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-7bc9dd09-34a7-450c-962e-526cb199226a None None] MFA Rules not processed for user `c58b4f9b474c492984a08198cb7df0a0`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:54:10.177757 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-7bc9dd09-34a7-450c-962e-526cb199226a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:54:10.187570 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 487/974] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 21 11:54:10 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:54:11.741824 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d69ac-d905-4d83-9b97-eab347c10209 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:11.742346 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d69ac-d905-4d83-9b97-eab347c10209 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:11.742466 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d69ac-d905-4d83-9b97-eab347c10209 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:11.743798 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 488/975] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 21 11:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:54:11.748836 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2217f6b-e38d-48b2-9e19-519f95612ed8 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:11.749228 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2217f6b-e38d-48b2-9e19-519f95612ed8 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:11.749371 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2217f6b-e38d-48b2-9e19-519f95612ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:11.769888 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-b2217f6b-e38d-48b2-9e19-519f95612ed8 None None] MFA Rules not processed for user `c58b4f9b474c492984a08198cb7df0a0`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:54:11.771047 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-b2217f6b-e38d-48b2-9e19-519f95612ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:54:11.779907 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 488/976] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 21 11:54:11 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:54:15.847705 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c74c1-24d5-4650-805a-c54e4f0dab18 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:15.848301 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c74c1-24d5-4650-805a-c54e4f0dab18 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:15.848301 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c74c1-24d5-4650-805a-c54e4f0dab18 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:15.849499 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 489/977] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:54:15.854723 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c8919-0ffd-482f-bb1a-965f6b14103f None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:15.855158 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c8919-0ffd-482f-bb1a-965f6b14103f None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:15.855454 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c8919-0ffd-482f-bb1a-965f6b14103f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:15.875378 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-285c8919-0ffd-482f-bb1a-965f6b14103f None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:54:15.876805 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-285c8919-0ffd-482f-bb1a-965f6b14103f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:54:15.885101 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 489/978] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:54:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:54:16.241131 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02197d8e-4e54-452d-b5d4-d38289c952e3 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:16.242224 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02197d8e-4e54-452d-b5d4-d38289c952e3 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:16.242809 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02197d8e-4e54-452d-b5d4-d38289c952e3 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:16.251742 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 490/979] 10.222.0.27 () {54 vars in 965 bytes} [Wed Sep 21 11:54:16 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:54:16.272371 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c64e3a-dbe4-478e-9433-8cb0b37295bf None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:16.272824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c64e3a-dbe4-478e-9433-8cb0b37295bf None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:16.273210 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c64e3a-dbe4-478e-9433-8cb0b37295bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:16.321702 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-b3c64e3a-dbe4-478e-9433-8cb0b37295bf None None] MFA Rules not processed for user `c683dcd33e5b40fabbbf12c3dcf97eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:54:16.323240 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-b3c64e3a-dbe4-478e-9433-8cb0b37295bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:54:16.398466 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:54:16.412205 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 490/980] 10.222.0.27 () {58 vars in 1062 bytes} [Wed Sep 21 11:54:16 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:54:16.413946 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02197d8e-4e54-452d-b5d4-d38289c952e3 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:54:16.428714 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02197d8e-4e54-452d-b5d4-d38289c952e3 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:54:16.433722 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787e7ae-ec7c-4b81-b65e-7ce264d9efea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c683dcd33e5b40fabbbf12c3dcf97eb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:54:16.434405 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787e7ae-ec7c-4b81-b65e-7ce264d9efea service nova] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:16.434775 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787e7ae-ec7c-4b81-b65e-7ce264d9efea service nova] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:16.435134 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787e7ae-ec7c-4b81-b65e-7ce264d9efea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:16.443952 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787e7ae-ec7c-4b81-b65e-7ce264d9efea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:54:16.445658 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787e7ae-ec7c-4b81-b65e-7ce264d9efea service nova] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:54:16.454850 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 491/981] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:54:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 11:54:19.085600 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25939155-66e5-4ec8-bacb-c727f9ce7bb4 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:19.086132 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25939155-66e5-4ec8-bacb-c727f9ce7bb4 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:19.086132 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25939155-66e5-4ec8-bacb-c727f9ce7bb4 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:19.087393 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 491/982] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:54:19.092728 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45595c83-3078-4f59-b6fc-df46f2455b3a None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:19.093120 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45595c83-3078-4f59-b6fc-df46f2455b3a None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:19.093274 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45595c83-3078-4f59-b6fc-df46f2455b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:19.112576 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-45595c83-3078-4f59-b6fc-df46f2455b3a None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:54:19.113994 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-45595c83-3078-4f59-b6fc-df46f2455b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:54:19.121873 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 492/983] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:54:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:54:19.479846 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25939155-66e5-4ec8-bacb-c727f9ce7bb4 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:54:19.503375 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25939155-66e5-4ec8-bacb-c727f9ce7bb4 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:54:19.509155 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cb1c3-d3bf-484e-9ed1-60457da918b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c683dcd33e5b40fabbbf12c3dcf97eb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:54:19.509772 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cb1c3-d3bf-484e-9ed1-60457da918b5 service nova] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:19.510209 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cb1c3-d3bf-484e-9ed1-60457da918b5 service nova] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:19.510209 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cb1c3-d3bf-484e-9ed1-60457da918b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:19.520262 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90cb1c3-d3bf-484e-9ed1-60457da918b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:54:19.522052 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90cb1c3-d3bf-484e-9ed1-60457da918b5 service nova] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:54:19.532475 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 492/984] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:54:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:54:22.278546 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2a156-4b8c-4afc-9334-68754ad59f22 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:22.279056 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2a156-4b8c-4afc-9334-68754ad59f22 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:22.279056 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2a156-4b8c-4afc-9334-68754ad59f22 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:22.281659 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 493/985] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:54:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:54:22.287435 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f90559-2be7-4cfc-861a-eed73afa9206 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:22.287920 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f90559-2be7-4cfc-861a-eed73afa9206 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:22.288031 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f90559-2be7-4cfc-861a-eed73afa9206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:22.310454 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-b9f90559-2be7-4cfc-861a-eed73afa9206 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:54:22.312492 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-b9f90559-2be7-4cfc-861a-eed73afa9206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:54:22.321970 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 493/986] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:54:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:54:22.678602 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45179f-cacd-4be2-836b-e8b243b1cd89 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:22.679083 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45179f-cacd-4be2-836b-e8b243b1cd89 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:22.679702 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45179f-cacd-4be2-836b-e8b243b1cd89 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:22.681335 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 494/987] 10.222.0.27 () {54 vars in 965 bytes} [Wed Sep 21 11:54:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:54:22.688092 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec7149-f07e-4219-b766-12ea9118b5ce None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:22.688851 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec7149-f07e-4219-b766-12ea9118b5ce None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:22.689371 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec7149-f07e-4219-b766-12ea9118b5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:22.714173 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-b1ec7149-f07e-4219-b766-12ea9118b5ce None None] MFA Rules not processed for user `c683dcd33e5b40fabbbf12c3dcf97eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:54:22.715475 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-b1ec7149-f07e-4219-b766-12ea9118b5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:54:22.725204 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 494/988] 10.222.0.27 () {58 vars in 1062 bytes} [Wed Sep 21 11:54:22 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:54:22.733202 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45179f-cacd-4be2-836b-e8b243b1cd89 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:54:22.747642 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45179f-cacd-4be2-836b-e8b243b1cd89 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:54:22.753386 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8e7c2-7d8e-4f48-8790-c60fbaaa2abf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c683dcd33e5b40fabbbf12c3dcf97eb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:54:22.753979 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8e7c2-7d8e-4f48-8790-c60fbaaa2abf service nova] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:22.754250 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8e7c2-7d8e-4f48-8790-c60fbaaa2abf service nova] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:22.754516 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8e7c2-7d8e-4f48-8790-c60fbaaa2abf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:22.763321 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8e7c2-7d8e-4f48-8790-c60fbaaa2abf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:54:22.765897 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8e7c2-7d8e-4f48-8790-c60fbaaa2abf service nova] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:54:22.777575 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 495/989] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:54:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:54:25.360943 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fec72c-f789-40b5-85c6-0b37fa812633 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:25.361517 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fec72c-f789-40b5-85c6-0b37fa812633 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:25.361517 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fec72c-f789-40b5-85c6-0b37fa812633 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:25.367311 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 495/990] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:54:25.369374 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63846327-db53-49dc-a99a-e298ebce7cd6 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:25.370187 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63846327-db53-49dc-a99a-e298ebce7cd6 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:25.370628 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63846327-db53-49dc-a99a-e298ebce7cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:25.391958 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-63846327-db53-49dc-a99a-e298ebce7cd6 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:54:25.393463 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-63846327-db53-49dc-a99a-e298ebce7cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:54:25.412415 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 496/991] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:54:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:54:25.759817 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fec72c-f789-40b5-85c6-0b37fa812633 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:54:25.774844 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fec72c-f789-40b5-85c6-0b37fa812633 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:54:25.780617 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a67a17-6394-4c50-9d4f-5252bcd25a9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c683dcd33e5b40fabbbf12c3dcf97eb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:54:25.781538 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a67a17-6394-4c50-9d4f-5252bcd25a9c service nova] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:25.782103 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a67a17-6394-4c50-9d4f-5252bcd25a9c service nova] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:25.782656 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a67a17-6394-4c50-9d4f-5252bcd25a9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:25.797523 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a67a17-6394-4c50-9d4f-5252bcd25a9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:54:25.800500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a67a17-6394-4c50-9d4f-5252bcd25a9c service nova] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:54:25.819115 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 496/992] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:54:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:54:26.086424 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131ee7f-cacb-4a93-a1d2-2d8e56277a2b None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:26.087096 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131ee7f-cacb-4a93-a1d2-2d8e56277a2b None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:26.087592 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131ee7f-cacb-4a93-a1d2-2d8e56277a2b None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:26.095664 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39758d83-5934-447b-90ef-b75ceb772ca4 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:26.096414 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39758d83-5934-447b-90ef-b75ceb772ca4 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:26.096895 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39758d83-5934-447b-90ef-b75ceb772ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:26.100378 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 497/993] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:54:26 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:54:26.125965 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-39758d83-5934-447b-90ef-b75ceb772ca4 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:54:26.127741 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-39758d83-5934-447b-90ef-b75ceb772ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:54:26.146157 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 497/994] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:54:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:54:26.542098 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b141e5-ea84-4261-936b-70b098c0c586 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:26.542098 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b141e5-ea84-4261-936b-70b098c0c586 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:26.542098 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b141e5-ea84-4261-936b-70b098c0c586 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:26.543684 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 498/995] 10.222.0.27 () {54 vars in 962 bytes} [Wed Sep 21 11:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:54:26.550366 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcede9-0e41-40f6-b8d2-0d61cf6ab03b None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:26.550928 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcede9-0e41-40f6-b8d2-0d61cf6ab03b None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:26.550928 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcede9-0e41-40f6-b8d2-0d61cf6ab03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:26.588802 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-2adcede9-0e41-40f6-b8d2-0d61cf6ab03b None None] MFA Rules not processed for user `75426336bd2d443fbe3f2dd97293fc15`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:54:26.589988 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-2adcede9-0e41-40f6-b8d2-0d61cf6ab03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:54:26.651282 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 498/996] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Sep 21 11:54:26 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:54:26.659554 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b141e5-ea84-4261-936b-70b098c0c586 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:54:26.671242 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b141e5-ea84-4261-936b-70b098c0c586 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:54:26.675863 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb52eb-9677-4d57-a7bc-3f492de8370c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75426336bd2d443fbe3f2dd97293fc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:54:26.676576 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb52eb-9677-4d57-a7bc-3f492de8370c service cinder] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:26.676924 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb52eb-9677-4d57-a7bc-3f492de8370c service cinder] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:26.677263 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb52eb-9677-4d57-a7bc-3f492de8370c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:26.687041 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb52eb-9677-4d57-a7bc-3f492de8370c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:54:26.688777 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb52eb-9677-4d57-a7bc-3f492de8370c service cinder] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:54:26.699484 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 499/997] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:54:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:54:28.358154 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1f657-0f49-41b2-a469-dc12fe9abab7 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:28.358996 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1f657-0f49-41b2-a469-dc12fe9abab7 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:28.359423 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1f657-0f49-41b2-a469-dc12fe9abab7 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:28.360788 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 499/998] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:54:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:54:28.366085 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af73ed-b832-44ba-82ba-23488fb49d3c None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:28.366513 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af73ed-b832-44ba-82ba-23488fb49d3c None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:28.366608 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af73ed-b832-44ba-82ba-23488fb49d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:28.386264 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-07af73ed-b832-44ba-82ba-23488fb49d3c None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:54:28.387457 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-07af73ed-b832-44ba-82ba-23488fb49d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:54:28.395958 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 500/999] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:54:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:54:28.739467 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1f657-0f49-41b2-a469-dc12fe9abab7 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:54:28.753462 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1f657-0f49-41b2-a469-dc12fe9abab7 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:54:28.758631 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb94cd3-697e-45a7-bf45-3913e4670c6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c683dcd33e5b40fabbbf12c3dcf97eb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:54:28.759223 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb94cd3-697e-45a7-bf45-3913e4670c6b service nova] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:28.759498 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb94cd3-697e-45a7-bf45-3913e4670c6b service nova] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:28.759766 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb94cd3-697e-45a7-bf45-3913e4670c6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:28.769797 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb94cd3-697e-45a7-bf45-3913e4670c6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:54:28.771392 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb94cd3-697e-45a7-bf45-3913e4670c6b service nova] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:54:28.781069 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 500/1000] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:54:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:54:31.273382 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667e006-5623-461b-b5c3-26f168fe61e8 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:31.274372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667e006-5623-461b-b5c3-26f168fe61e8 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:31.274846 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667e006-5623-461b-b5c3-26f168fe61e8 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:31.277007 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 501/1001] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:54:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:54:31.281767 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3ef00-1b35-4ccc-883a-d85381790291 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:31.282204 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3ef00-1b35-4ccc-883a-d85381790291 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:31.282497 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3ef00-1b35-4ccc-883a-d85381790291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:31.306221 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-dee3ef00-1b35-4ccc-883a-d85381790291 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:54:31.307588 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-dee3ef00-1b35-4ccc-883a-d85381790291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:54:31.324683 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 501/1002] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:54:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:54:31.660354 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667e006-5623-461b-b5c3-26f168fe61e8 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:54:31.675404 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667e006-5623-461b-b5c3-26f168fe61e8 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:54:31.681249 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18257e21-d695-44e6-9751-5d7fdd0bdab6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c683dcd33e5b40fabbbf12c3dcf97eb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:54:31.681847 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18257e21-d695-44e6-9751-5d7fdd0bdab6 service nova] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:31.682122 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18257e21-d695-44e6-9751-5d7fdd0bdab6 service nova] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:31.682390 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18257e21-d695-44e6-9751-5d7fdd0bdab6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:31.692155 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18257e21-d695-44e6-9751-5d7fdd0bdab6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:54:31.693723 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18257e21-d695-44e6-9751-5d7fdd0bdab6 service nova] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:54:31.703868 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 502/1003] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:54:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:54:34.145951 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a4566-2a42-46d4-9d52-ff4313b91919 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:34.146546 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a4566-2a42-46d4-9d52-ff4313b91919 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:34.146546 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a4566-2a42-46d4-9d52-ff4313b91919 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:34.148128 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 502/1004] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:54:34.153091 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feffdee-d97f-4c6c-a00b-fd7ca53d5a71 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:34.153502 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feffdee-d97f-4c6c-a00b-fd7ca53d5a71 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:34.153626 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feffdee-d97f-4c6c-a00b-fd7ca53d5a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:34.174303 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-7feffdee-d97f-4c6c-a00b-fd7ca53d5a71 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:54:34.175483 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-7feffdee-d97f-4c6c-a00b-fd7ca53d5a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:54:34.184031 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 503/1005] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:54:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:54:34.531789 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a4566-2a42-46d4-9d52-ff4313b91919 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:54:34.546416 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a4566-2a42-46d4-9d52-ff4313b91919 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:54:34.551489 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66411b6b-6b61-46f0-94ae-53d66e21f2c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c683dcd33e5b40fabbbf12c3dcf97eb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:54:34.552093 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66411b6b-6b61-46f0-94ae-53d66e21f2c8 service nova] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:34.552366 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66411b6b-6b61-46f0-94ae-53d66e21f2c8 service nova] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:34.552626 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66411b6b-6b61-46f0-94ae-53d66e21f2c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:34.561320 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66411b6b-6b61-46f0-94ae-53d66e21f2c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:54:34.562906 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66411b6b-6b61-46f0-94ae-53d66e21f2c8 service nova] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:54:34.572545 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 503/1006] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:54:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:54:37.322736 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1e23b-4a30-4bd3-928b-6df4d0237da1 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:37.344651 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1e23b-4a30-4bd3-928b-6df4d0237da1 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:37.344651 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1e23b-4a30-4bd3-928b-6df4d0237da1 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:37.344651 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 504/1007] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:54:37.345860 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a4825-2046-45fc-ad90-f5719c77a7ae None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:37.345860 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a4825-2046-45fc-ad90-f5719c77a7ae None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:37.345860 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a4825-2046-45fc-ad90-f5719c77a7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:37.359171 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-072a4825-2046-45fc-ad90-f5719c77a7ae None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:54:37.360465 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-072a4825-2046-45fc-ad90-f5719c77a7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:54:37.368316 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 504/1008] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:54:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:54:37.719144 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1e23b-4a30-4bd3-928b-6df4d0237da1 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:54:37.732821 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1e23b-4a30-4bd3-928b-6df4d0237da1 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:54:37.737826 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f9721-f9a9-4b99-9304-cde1c7ba85c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c683dcd33e5b40fabbbf12c3dcf97eb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:54:37.738424 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f9721-f9a9-4b99-9304-cde1c7ba85c5 service nova] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:37.738709 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f9721-f9a9-4b99-9304-cde1c7ba85c5 service nova] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:37.738983 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f9721-f9a9-4b99-9304-cde1c7ba85c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:37.747567 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f9721-f9a9-4b99-9304-cde1c7ba85c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:54:37.749828 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f9721-f9a9-4b99-9304-cde1c7ba85c5 service nova] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:54:37.759965 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 505/1009] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:54:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:54:40.846829 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e86ef6-06cc-4700-83d9-a57dcac58e25 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:40.847505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e86ef6-06cc-4700-83d9-a57dcac58e25 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:40.847505 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e86ef6-06cc-4700-83d9-a57dcac58e25 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:40.848882 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 505/1010] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:54:40.854391 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752cf59-3139-4cf2-b482-8a7861a2f6ac None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:40.854876 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752cf59-3139-4cf2-b482-8a7861a2f6ac None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:40.854983 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752cf59-3139-4cf2-b482-8a7861a2f6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:40.862493 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=43 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:54:40.875533 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-7752cf59-3139-4cf2-b482-8a7861a2f6ac None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:54:40.876772 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-7752cf59-3139-4cf2-b482-8a7861a2f6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:54:40.884592 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 506/1011] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:54:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:54:41.233971 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e86ef6-06cc-4700-83d9-a57dcac58e25 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:54:41.247356 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e86ef6-06cc-4700-83d9-a57dcac58e25 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:54:41.252793 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9eb13-18af-4558-a791-e7e1d84cb15f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c683dcd33e5b40fabbbf12c3dcf97eb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:54:41.253367 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9eb13-18af-4558-a791-e7e1d84cb15f service nova] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:41.253635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9eb13-18af-4558-a791-e7e1d84cb15f service nova] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:41.253898 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9eb13-18af-4558-a791-e7e1d84cb15f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:41.261700 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9eb13-18af-4558-a791-e7e1d84cb15f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:54:41.263294 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9eb13-18af-4558-a791-e7e1d84cb15f service nova] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:54:41.272611 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 506/1012] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:54:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:54:43.036494 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5aa79b-b9b1-4281-9f4c-428bad5386aa None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:43.037202 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5aa79b-b9b1-4281-9f4c-428bad5386aa None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:43.037202 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5aa79b-b9b1-4281-9f4c-428bad5386aa None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:43.038363 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 507/1013] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:54:43.044018 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670038c-1214-4141-a8aa-c3af8541b776 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:43.044534 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670038c-1214-4141-a8aa-c3af8541b776 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:43.044698 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670038c-1214-4141-a8aa-c3af8541b776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:43.064579 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-d670038c-1214-4141-a8aa-c3af8541b776 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:54:43.065761 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-d670038c-1214-4141-a8aa-c3af8541b776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:54:43.073563 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 507/1014] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:54:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:54:43.433273 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1ea84-613e-4573-8b86-71464a140208 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:43.433561 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1ea84-613e-4573-8b86-71464a140208 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:43.433840 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1ea84-613e-4573-8b86-71464a140208 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:43.435158 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 508/1015] 10.222.0.27 () {54 vars in 962 bytes} [Wed Sep 21 11:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:54:43.440644 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57885c-4001-44c6-8810-e6e4c122c94c None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:43.440922 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57885c-4001-44c6-8810-e6e4c122c94c None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:43.441187 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57885c-4001-44c6-8810-e6e4c122c94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:43.479446 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-fa57885c-4001-44c6-8810-e6e4c122c94c None None] MFA Rules not processed for user `f4e6b7bc6eea49ba9f54b0305f3173b0`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:54:43.480679 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-fa57885c-4001-44c6-8810-e6e4c122c94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:54:43.500383 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:54:43.540937 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 508/1016] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Sep 21 11:54:43 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:54:43.548781 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1ea84-613e-4573-8b86-71464a140208 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:54:43.559067 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1ea84-613e-4573-8b86-71464a140208 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:54:43.562528 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af207a4d-3172-47d4-8ab4-35e133e9d702 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e6b7bc6eea49ba9f54b0305f3173b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:54:43.563113 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af207a4d-3172-47d4-8ab4-35e133e9d702 service glance] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:43.563388 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af207a4d-3172-47d4-8ab4-35e133e9d702 service glance] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:43.563658 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af207a4d-3172-47d4-8ab4-35e133e9d702 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:43.572404 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af207a4d-3172-47d4-8ab4-35e133e9d702 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:54:43.573837 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af207a4d-3172-47d4-8ab4-35e133e9d702 service glance] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:54:43.593199 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 509/1017] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:54:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:54:43.748675 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6370b-5915-4c44-a4d0-95c69eb96e9d None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:43.749075 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6370b-5915-4c44-a4d0-95c69eb96e9d None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:43.749398 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6370b-5915-4c44-a4d0-95c69eb96e9d None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:43.750822 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 509/1018] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:54:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:54:43.756067 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c96e0b-b8f0-4b61-8c55-ca72e697f240 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:43.756357 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c96e0b-b8f0-4b61-8c55-ca72e697f240 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:43.756635 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c96e0b-b8f0-4b61-8c55-ca72e697f240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:43.776730 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-f3c96e0b-b8f0-4b61-8c55-ca72e697f240 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:54:43.777949 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-f3c96e0b-b8f0-4b61-8c55-ca72e697f240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:54:43.786360 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 510/1019] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:54:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:54:44.136803 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6370b-5915-4c44-a4d0-95c69eb96e9d None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:54:44.151569 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6370b-5915-4c44-a4d0-95c69eb96e9d None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:54:44.156328 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93677eb4-5823-4676-8bc9-f87a14d7cce5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c683dcd33e5b40fabbbf12c3dcf97eb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:54:44.157020 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93677eb4-5823-4676-8bc9-f87a14d7cce5 service nova] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:44.157295 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93677eb4-5823-4676-8bc9-f87a14d7cce5 service nova] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:44.157558 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93677eb4-5823-4676-8bc9-f87a14d7cce5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:44.167084 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93677eb4-5823-4676-8bc9-f87a14d7cce5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:54:44.169060 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93677eb4-5823-4676-8bc9-f87a14d7cce5 service nova] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:54:44.179902 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 510/1020] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:54:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:54:46.679371 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f91846-bc2a-4da5-89c6-d2ca430f0367 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:46.680050 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f91846-bc2a-4da5-89c6-d2ca430f0367 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:46.680050 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f91846-bc2a-4da5-89c6-d2ca430f0367 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:46.681444 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 511/1021] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:54:46.687198 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14746d-f83c-468e-b898-df428779bf35 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:46.687716 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14746d-f83c-468e-b898-df428779bf35 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:46.687716 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14746d-f83c-468e-b898-df428779bf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:46.707324 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-da14746d-f83c-468e-b898-df428779bf35 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:54:46.708534 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-da14746d-f83c-468e-b898-df428779bf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:54:46.716177 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 511/1022] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:54:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:54:47.059808 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f91846-bc2a-4da5-89c6-d2ca430f0367 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:54:47.073644 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f91846-bc2a-4da5-89c6-d2ca430f0367 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:54:47.079036 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce27e49-40cd-4053-918c-805dc58141b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c683dcd33e5b40fabbbf12c3dcf97eb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:54:47.079652 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce27e49-40cd-4053-918c-805dc58141b1 service nova] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:47.079927 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce27e49-40cd-4053-918c-805dc58141b1 service nova] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:47.080229 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce27e49-40cd-4053-918c-805dc58141b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:47.089154 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce27e49-40cd-4053-918c-805dc58141b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:54:47.090733 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce27e49-40cd-4053-918c-805dc58141b1 service nova] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:54:47.101698 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 512/1023] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:54:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:54:49.751652 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5255967-92f8-4ad1-a7bd-2560b8dc6a68 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:49.752372 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5255967-92f8-4ad1-a7bd-2560b8dc6a68 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:49.752372 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5255967-92f8-4ad1-a7bd-2560b8dc6a68 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:49.753557 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 512/1024] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:54:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:54:49.758889 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15eeb4-40c1-420a-a649-56fcca1b0a63 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:49.759368 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15eeb4-40c1-420a-a649-56fcca1b0a63 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:49.759476 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15eeb4-40c1-420a-a649-56fcca1b0a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:49.780341 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-3e15eeb4-40c1-420a-a649-56fcca1b0a63 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:54:49.781640 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-3e15eeb4-40c1-420a-a649-56fcca1b0a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:54:49.789756 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 513/1025] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:54:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:54:50.145366 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5255967-92f8-4ad1-a7bd-2560b8dc6a68 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:54:50.160654 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5255967-92f8-4ad1-a7bd-2560b8dc6a68 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:54:50.165887 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496df789-34f6-4296-961f-d0e47eb40ad7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c683dcd33e5b40fabbbf12c3dcf97eb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:54:50.166485 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496df789-34f6-4296-961f-d0e47eb40ad7 service nova] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:50.166762 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496df789-34f6-4296-961f-d0e47eb40ad7 service nova] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:50.167027 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496df789-34f6-4296-961f-d0e47eb40ad7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:50.175808 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496df789-34f6-4296-961f-d0e47eb40ad7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:54:50.177451 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496df789-34f6-4296-961f-d0e47eb40ad7 service nova] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:54:50.188852 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 513/1026] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:54:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:54:59.111932 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c52909-9e4c-44b2-a551-0411d1c71911 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:59.112660 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c52909-9e4c-44b2-a551-0411d1c71911 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:59.112660 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c52909-9e4c-44b2-a551-0411d1c71911 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:59.113806 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 514/1027] 10.222.0.27 () {54 vars in 918 bytes} [Wed Sep 21 11:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:54:59.118742 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103b2db-9649-4e97-94f9-94be271d665d None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:59.119189 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103b2db-9649-4e97-94f9-94be271d665d None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:59.119289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103b2db-9649-4e97-94f9-94be271d665d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:59.138289 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-8103b2db-9649-4e97-94f9-94be271d665d None None] MFA Rules not processed for user `c58b4f9b474c492984a08198cb7df0a0`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:54:59.140025 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-8103b2db-9649-4e97-94f9-94be271d665d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:54:59.148657 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 514/1028] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Sep 21 11:54:59 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:54:59.163015 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359a43f-3d3b-467d-9813-db8b903190bf None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:59.163292 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359a43f-3d3b-467d-9813-db8b903190bf None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:59.163556 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359a43f-3d3b-467d-9813-db8b903190bf None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:59.165128 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 515/1029] 10.222.0.27 () {54 vars in 918 bytes} [Wed Sep 21 11:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:54:59.169529 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b58c9-7489-4906-8bf3-167ae9f6f862 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:54:59.169806 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b58c9-7489-4906-8bf3-167ae9f6f862 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:54:59.170094 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b58c9-7489-4906-8bf3-167ae9f6f862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:54:59.188907 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-da4b58c9-7489-4906-8bf3-167ae9f6f862 None None] MFA Rules not processed for user `c683dcd33e5b40fabbbf12c3dcf97eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:54:59.190057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-da4b58c9-7489-4906-8bf3-167ae9f6f862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:54:59.198125 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 515/1030] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Sep 21 11:54:59 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:54:59.775277 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=20 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:55:02.058712 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795df6e7-a659-4974-902a-a550f976ea04 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:02.059383 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795df6e7-a659-4974-902a-a550f976ea04 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:02.059383 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795df6e7-a659-4974-902a-a550f976ea04 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:02.060602 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 516/1031] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 11:55:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:55:02.065852 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7331c-4ac4-4ef3-bc8a-c6aa1c30449d None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:02.066302 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7331c-4ac4-4ef3-bc8a-c6aa1c30449d None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:02.066415 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7331c-4ac4-4ef3-bc8a-c6aa1c30449d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:02.085818 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-52e7331c-4ac4-4ef3-bc8a-c6aa1c30449d None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:55:02.086997 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-52e7331c-4ac4-4ef3-bc8a-c6aa1c30449d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:55:02.095299 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 516/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 11:55:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:55:02.433934 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795df6e7-a659-4974-902a-a550f976ea04 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:55:02.447471 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795df6e7-a659-4974-902a-a550f976ea04 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:55:02.452464 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5be1e2-0925-4e6d-a041-600833ba5dc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c683dcd33e5b40fabbbf12c3dcf97eb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:55:02.453045 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5be1e2-0925-4e6d-a041-600833ba5dc6 service nova] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:02.453322 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5be1e2-0925-4e6d-a041-600833ba5dc6 service nova] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:02.453591 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5be1e2-0925-4e6d-a041-600833ba5dc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:02.461507 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5be1e2-0925-4e6d-a041-600833ba5dc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:55:02.463077 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5be1e2-0925-4e6d-a041-600833ba5dc6 service nova] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:55:02.472801 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 517/1033] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:55:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:55:04.181382 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce08e4b-b323-4013-be72-005a44fa6cb9 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:04.181961 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce08e4b-b323-4013-be72-005a44fa6cb9 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:04.181961 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce08e4b-b323-4013-be72-005a44fa6cb9 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:04.183218 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 517/1034] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 11:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:55:04.188547 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232248e-18ff-46c3-8346-e27bb3945be5 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:04.188995 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232248e-18ff-46c3-8346-e27bb3945be5 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:04.189100 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232248e-18ff-46c3-8346-e27bb3945be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:04.208546 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-0232248e-18ff-46c3-8346-e27bb3945be5 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:55:04.209709 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-0232248e-18ff-46c3-8346-e27bb3945be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:55:04.217196 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 518/1035] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 11:55:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:55:04.438208 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce08e4b-b323-4013-be72-005a44fa6cb9 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:55:04.451215 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce08e4b-b323-4013-be72-005a44fa6cb9 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:55:04.456775 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a9615-5409-4217-a442-77221cda8156 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c683dcd33e5b40fabbbf12c3dcf97eb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:55:04.457386 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a9615-5409-4217-a442-77221cda8156 service nova] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:04.457656 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a9615-5409-4217-a442-77221cda8156 service nova] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:04.457919 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a9615-5409-4217-a442-77221cda8156 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:04.466011 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a9615-5409-4217-a442-77221cda8156 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:55:04.467583 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a9615-5409-4217-a442-77221cda8156 service nova] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:55:04.476927 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 518/1036] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:55:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 11:55:06.159329 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd176377-0491-48fe-ae40-c9fb85ddd2b3 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:06.159926 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd176377-0491-48fe-ae40-c9fb85ddd2b3 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:06.159926 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd176377-0491-48fe-ae40-c9fb85ddd2b3 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:06.161202 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 519/1037] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 11:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:55:06.166207 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989efdc-0e4c-4462-8dc9-ca9406a00b40 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:06.166611 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989efdc-0e4c-4462-8dc9-ca9406a00b40 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:06.166721 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989efdc-0e4c-4462-8dc9-ca9406a00b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:06.185686 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-9989efdc-0e4c-4462-8dc9-ca9406a00b40 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:55:06.187380 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-9989efdc-0e4c-4462-8dc9-ca9406a00b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:55:06.194975 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 519/1038] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 11:55:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:55:06.351825 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd176377-0491-48fe-ae40-c9fb85ddd2b3 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:55:06.365649 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd176377-0491-48fe-ae40-c9fb85ddd2b3 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:55:06.370459 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb22e3-0f9e-4ed1-b0d9-3d8024f1fec3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c683dcd33e5b40fabbbf12c3dcf97eb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:55:06.371038 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb22e3-0f9e-4ed1-b0d9-3d8024f1fec3 service nova] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:06.371311 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb22e3-0f9e-4ed1-b0d9-3d8024f1fec3 service nova] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:06.371579 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb22e3-0f9e-4ed1-b0d9-3d8024f1fec3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:06.379412 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb22e3-0f9e-4ed1-b0d9-3d8024f1fec3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:55:06.381006 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb22e3-0f9e-4ed1-b0d9-3d8024f1fec3 service nova] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:55:06.390405 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 520/1039] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:55:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:55:08.054823 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25aeae2-52b5-4482-9415-6e731893b65c None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:08.055412 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25aeae2-52b5-4482-9415-6e731893b65c None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:08.055412 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25aeae2-52b5-4482-9415-6e731893b65c None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:08.056736 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 520/1040] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 11:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:55:08.061654 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c7e34-d34e-4518-baa6-ff9c1f2a6d98 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:08.062063 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c7e34-d34e-4518-baa6-ff9c1f2a6d98 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:08.062188 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c7e34-d34e-4518-baa6-ff9c1f2a6d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:08.081514 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-c56c7e34-d34e-4518-baa6-ff9c1f2a6d98 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:55:08.082668 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-c56c7e34-d34e-4518-baa6-ff9c1f2a6d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:55:08.090201 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 521/1041] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 11:55:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:55:08.244944 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25aeae2-52b5-4482-9415-6e731893b65c None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:55:08.258950 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25aeae2-52b5-4482-9415-6e731893b65c None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:55:08.264228 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c21d1b-9a6d-4db9-9487-cc3ac5650540 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c683dcd33e5b40fabbbf12c3dcf97eb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:55:08.264866 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c21d1b-9a6d-4db9-9487-cc3ac5650540 service nova] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:08.265134 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c21d1b-9a6d-4db9-9487-cc3ac5650540 service nova] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:08.265360 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c21d1b-9a6d-4db9-9487-cc3ac5650540 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:08.273519 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c21d1b-9a6d-4db9-9487-cc3ac5650540 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:55:08.275089 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c21d1b-9a6d-4db9-9487-cc3ac5650540 service nova] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:55:08.284410 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 521/1042] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:55:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:55:09.961024 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee92ff-72a6-4885-8e79-f8f34c54ef0d None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:09.961604 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee92ff-72a6-4885-8e79-f8f34c54ef0d None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:09.961604 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee92ff-72a6-4885-8e79-f8f34c54ef0d None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:09.962877 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 522/1043] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 11:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:55:09.967755 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c93c6-9993-4c8c-88e7-ef1bc2b05169 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:09.968199 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c93c6-9993-4c8c-88e7-ef1bc2b05169 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:09.968317 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c93c6-9993-4c8c-88e7-ef1bc2b05169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:09.987278 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-d54c93c6-9993-4c8c-88e7-ef1bc2b05169 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:55:09.988500 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-d54c93c6-9993-4c8c-88e7-ef1bc2b05169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:55:09.996169 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 522/1044] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 11:55:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:55:10.152144 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee92ff-72a6-4885-8e79-f8f34c54ef0d None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:55:10.165549 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee92ff-72a6-4885-8e79-f8f34c54ef0d None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:55:10.170535 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db007a-5fce-4370-94da-2d669c87b87b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c683dcd33e5b40fabbbf12c3dcf97eb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:55:10.171117 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db007a-5fce-4370-94da-2d669c87b87b service nova] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:10.171391 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db007a-5fce-4370-94da-2d669c87b87b service nova] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:10.171660 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db007a-5fce-4370-94da-2d669c87b87b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:10.179653 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db007a-5fce-4370-94da-2d669c87b87b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:55:10.181252 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db007a-5fce-4370-94da-2d669c87b87b service nova] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:55:10.190903 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 523/1045] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:55:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:55:11.790054 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761e625-c91e-40fe-a444-ec6ff64f1e66 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:11.790837 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761e625-c91e-40fe-a444-ec6ff64f1e66 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:11.790837 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761e625-c91e-40fe-a444-ec6ff64f1e66 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:11.792226 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 523/1046] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 11:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:55:11.797398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fbc4a-a3ed-490c-a627-765c5dd70591 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:11.797822 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fbc4a-a3ed-490c-a627-765c5dd70591 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:11.798006 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fbc4a-a3ed-490c-a627-765c5dd70591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:11.817363 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-455fbc4a-a3ed-490c-a627-765c5dd70591 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:55:11.818526 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-455fbc4a-a3ed-490c-a627-765c5dd70591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:55:11.826191 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 524/1047] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 11:55:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 11:55:11.980869 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9761e625-c91e-40fe-a444-ec6ff64f1e66 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:55:11.994881 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9761e625-c91e-40fe-a444-ec6ff64f1e66 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:55:12.000628 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453691e-7373-4afd-9483-6f5def39b6a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c683dcd33e5b40fabbbf12c3dcf97eb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:55:12.001209 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453691e-7373-4afd-9483-6f5def39b6a3 service nova] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:12.001498 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453691e-7373-4afd-9483-6f5def39b6a3 service nova] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:12.001765 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453691e-7373-4afd-9483-6f5def39b6a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:12.009793 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453691e-7373-4afd-9483-6f5def39b6a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:55:12.011341 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453691e-7373-4afd-9483-6f5def39b6a3 service nova] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:55:12.020905 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 524/1048] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:55:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:55:13.635912 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056ed92-8954-48cc-b25a-934162bf57b5 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:13.636458 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056ed92-8954-48cc-b25a-934162bf57b5 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:13.636458 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056ed92-8954-48cc-b25a-934162bf57b5 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:13.637842 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 525/1049] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 11:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:55:13.643260 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2b165-4138-44c4-a504-eb8e5b5a5261 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:13.643678 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2b165-4138-44c4-a504-eb8e5b5a5261 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:13.643790 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2b165-4138-44c4-a504-eb8e5b5a5261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:13.651391 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=64 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:55:13.664259 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-edc2b165-4138-44c4-a504-eb8e5b5a5261 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:55:13.665710 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-edc2b165-4138-44c4-a504-eb8e5b5a5261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:55:13.673568 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 525/1050] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 11:55:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:55:13.831663 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056ed92-8954-48cc-b25a-934162bf57b5 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:55:13.845021 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056ed92-8954-48cc-b25a-934162bf57b5 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:55:13.849898 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c27fdb-6240-4ad8-b0c1-c39a61233c46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c683dcd33e5b40fabbbf12c3dcf97eb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:55:13.850481 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c27fdb-6240-4ad8-b0c1-c39a61233c46 service nova] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:13.850757 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c27fdb-6240-4ad8-b0c1-c39a61233c46 service nova] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:13.851025 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c27fdb-6240-4ad8-b0c1-c39a61233c46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:13.858926 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c27fdb-6240-4ad8-b0c1-c39a61233c46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:55:13.860512 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c27fdb-6240-4ad8-b0c1-c39a61233c46 service nova] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:55:13.869593 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 526/1051] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:55:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 11:55:15.490264 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fb862-211d-4366-a0a7-dec35fc831bf None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:15.490850 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fb862-211d-4366-a0a7-dec35fc831bf None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:15.490850 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fb862-211d-4366-a0a7-dec35fc831bf None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:15.492149 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 526/1052] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 11:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:55:15.496891 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445a539-c6e1-46eb-b93d-7111d2781850 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:15.497326 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445a539-c6e1-46eb-b93d-7111d2781850 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:15.497460 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445a539-c6e1-46eb-b93d-7111d2781850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:15.517407 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-9445a539-c6e1-46eb-b93d-7111d2781850 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:55:15.518585 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-9445a539-c6e1-46eb-b93d-7111d2781850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:55:15.526751 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 527/1053] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 11:55:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:55:15.683915 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fb862-211d-4366-a0a7-dec35fc831bf None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:55:15.697424 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fb862-211d-4366-a0a7-dec35fc831bf None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:55:15.702726 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1bf53-d439-429f-be20-8a5fd04672e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c683dcd33e5b40fabbbf12c3dcf97eb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:55:15.703302 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1bf53-d439-429f-be20-8a5fd04672e2 service nova] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:15.703571 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1bf53-d439-429f-be20-8a5fd04672e2 service nova] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:15.703836 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1bf53-d439-429f-be20-8a5fd04672e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:15.711892 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1bf53-d439-429f-be20-8a5fd04672e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:55:15.713489 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1bf53-d439-429f-be20-8a5fd04672e2 service nova] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:55:15.724592 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 527/1054] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:55:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:55:17.310018 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7034da-e08e-4865-9fc9-3fd9f10d7556 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:17.310555 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7034da-e08e-4865-9fc9-3fd9f10d7556 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:17.310555 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7034da-e08e-4865-9fc9-3fd9f10d7556 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:17.311881 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 528/1055] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 11:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:55:17.316627 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2f7e6-aa41-4d2a-ade2-a0cbefb30ec1 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:17.317034 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2f7e6-aa41-4d2a-ade2-a0cbefb30ec1 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:17.317126 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2f7e6-aa41-4d2a-ade2-a0cbefb30ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:17.336534 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-8af2f7e6-aa41-4d2a-ade2-a0cbefb30ec1 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:55:17.337694 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-8af2f7e6-aa41-4d2a-ade2-a0cbefb30ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:55:17.345795 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 528/1056] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 11:55:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:55:17.497889 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7034da-e08e-4865-9fc9-3fd9f10d7556 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:55:17.511638 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7034da-e08e-4865-9fc9-3fd9f10d7556 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:55:17.517191 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb9ebc-9b91-4f50-b0c2-ce5c1c436b49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c683dcd33e5b40fabbbf12c3dcf97eb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:55:17.517766 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb9ebc-9b91-4f50-b0c2-ce5c1c436b49 service nova] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:17.518041 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb9ebc-9b91-4f50-b0c2-ce5c1c436b49 service nova] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:17.518308 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb9ebc-9b91-4f50-b0c2-ce5c1c436b49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:17.526161 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb9ebc-9b91-4f50-b0c2-ce5c1c436b49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:55:17.527723 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb9ebc-9b91-4f50-b0c2-ce5c1c436b49 service nova] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:55:17.536901 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 529/1057] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:55:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:55:19.850642 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68652a9-bf1a-4e29-a81d-c711280989bb None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:19.851156 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68652a9-bf1a-4e29-a81d-c711280989bb None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:19.851156 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68652a9-bf1a-4e29-a81d-c711280989bb None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:19.852450 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 529/1058] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 11:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:55:19.857547 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157eaef-0466-4483-84ee-aad4a208944d None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:19.858010 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157eaef-0466-4483-84ee-aad4a208944d None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:19.858117 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157eaef-0466-4483-84ee-aad4a208944d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:19.877704 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-c157eaef-0466-4483-84ee-aad4a208944d None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:55:19.878903 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-c157eaef-0466-4483-84ee-aad4a208944d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:55:19.886544 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 530/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 11:55:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:55:20.223694 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68652a9-bf1a-4e29-a81d-c711280989bb None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:55:20.234901 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68652a9-bf1a-4e29-a81d-c711280989bb None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:55:20.238398 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552174d-932f-401c-9958-685f763189a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:55:20.238988 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552174d-932f-401c-9958-685f763189a1 service neutron] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:20.239246 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552174d-932f-401c-9958-685f763189a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:20.239532 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552174d-932f-401c-9958-685f763189a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:20.249151 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552174d-932f-401c-9958-685f763189a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:55:20.250543 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552174d-932f-401c-9958-685f763189a1 service neutron] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:55:20.259757 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 530/1060] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:55:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:55:22.810797 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71b60d-c579-4fad-b672-9b0df10e779a None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:22.811867 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71b60d-c579-4fad-b672-9b0df10e779a None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:22.811867 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71b60d-c579-4fad-b672-9b0df10e779a None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:22.813192 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 531/1061] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 11:55:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:55:22.818395 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dedf72-af27-4185-80b4-f85c31dac213 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:22.818868 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dedf72-af27-4185-80b4-f85c31dac213 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:22.818966 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dedf72-af27-4185-80b4-f85c31dac213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:22.841014 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-62dedf72-af27-4185-80b4-f85c31dac213 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:55:22.842249 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-62dedf72-af27-4185-80b4-f85c31dac213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:55:22.850039 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 531/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 11:55:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:55:23.196611 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71b60d-c579-4fad-b672-9b0df10e779a None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:55:23.207789 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71b60d-c579-4fad-b672-9b0df10e779a None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:55:23.211177 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161ab10-b48e-4d29-9c0f-d5936c12b1da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:55:23.211750 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161ab10-b48e-4d29-9c0f-d5936c12b1da service neutron] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:23.212054 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161ab10-b48e-4d29-9c0f-d5936c12b1da service neutron] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:23.212326 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161ab10-b48e-4d29-9c0f-d5936c12b1da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:23.221466 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161ab10-b48e-4d29-9c0f-d5936c12b1da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:55:23.222875 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161ab10-b48e-4d29-9c0f-d5936c12b1da service neutron] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:55:23.231817 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 532/1063] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:55:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:55:25.904862 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0785f-b469-4fda-875a-31309602f016 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:25.905398 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0785f-b469-4fda-875a-31309602f016 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:25.905398 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0785f-b469-4fda-875a-31309602f016 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:25.906729 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 532/1064] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 11:55:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:55:25.911972 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dd7f2-3922-4f5a-977b-cef76e1f4079 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:25.912406 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dd7f2-3922-4f5a-977b-cef76e1f4079 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:25.912572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dd7f2-3922-4f5a-977b-cef76e1f4079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:25.931977 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-ab8dd7f2-3922-4f5a-977b-cef76e1f4079 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:55:25.933191 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-ab8dd7f2-3922-4f5a-977b-cef76e1f4079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:55:25.941240 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 533/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 11:55:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:55:26.279133 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0785f-b469-4fda-875a-31309602f016 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:55:26.290663 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0785f-b469-4fda-875a-31309602f016 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:55:26.294945 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f1dc9-dc63-4412-8456-16c1bd56145d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:55:26.295522 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f1dc9-dc63-4412-8456-16c1bd56145d service neutron] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:26.295798 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f1dc9-dc63-4412-8456-16c1bd56145d service neutron] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:26.296098 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f1dc9-dc63-4412-8456-16c1bd56145d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:26.304845 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f1dc9-dc63-4412-8456-16c1bd56145d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:55:26.306301 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f1dc9-dc63-4412-8456-16c1bd56145d service neutron] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:55:26.315424 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 533/1066] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:55:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:55:28.858271 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cd38f-dcc9-4f41-b044-82ce9e873eea None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:28.858799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cd38f-dcc9-4f41-b044-82ce9e873eea None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:28.858799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cd38f-dcc9-4f41-b044-82ce9e873eea None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:28.860067 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 534/1067] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 11:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:55:28.865904 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee776676-2fe3-44c5-8f47-14e31cd24aca None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:28.866352 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee776676-2fe3-44c5-8f47-14e31cd24aca None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:28.866459 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee776676-2fe3-44c5-8f47-14e31cd24aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:28.884981 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-ee776676-2fe3-44c5-8f47-14e31cd24aca None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:55:28.886160 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-ee776676-2fe3-44c5-8f47-14e31cd24aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:55:28.893959 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 534/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 11:55:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:55:29.233833 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271cd38f-dcc9-4f41-b044-82ce9e873eea None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:55:29.244366 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271cd38f-dcc9-4f41-b044-82ce9e873eea None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:55:29.247720 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455cddf5-e98e-42d2-8562-53f75672b4b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:55:29.248339 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cddf5-e98e-42d2-8562-53f75672b4b5 service neutron] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:29.248667 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cddf5-e98e-42d2-8562-53f75672b4b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:29.249013 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cddf5-e98e-42d2-8562-53f75672b4b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:29.257721 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455cddf5-e98e-42d2-8562-53f75672b4b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:55:29.259125 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455cddf5-e98e-42d2-8562-53f75672b4b5 service neutron] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:55:29.268715 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 535/1069] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:55:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:55:31.755382 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a6489-39ff-45a7-97c7-c800d0ad17ff None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:31.756017 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a6489-39ff-45a7-97c7-c800d0ad17ff None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:31.756017 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a6489-39ff-45a7-97c7-c800d0ad17ff None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:31.757261 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 535/1070] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 11:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:55:31.762436 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094b63f-cf8c-423e-81cb-1f17c4575cb7 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:31.762885 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094b63f-cf8c-423e-81cb-1f17c4575cb7 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:31.762989 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094b63f-cf8c-423e-81cb-1f17c4575cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:31.770843 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=61 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:55:31.784016 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-3094b63f-cf8c-423e-81cb-1f17c4575cb7 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:55:31.785218 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-3094b63f-cf8c-423e-81cb-1f17c4575cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:55:31.793190 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 536/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 11:55:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:55:32.138223 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a6489-39ff-45a7-97c7-c800d0ad17ff None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:55:32.149608 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a6489-39ff-45a7-97c7-c800d0ad17ff None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:55:32.153274 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e99385-0505-4c4d-8319-0a7dde153f5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:55:32.153869 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e99385-0505-4c4d-8319-0a7dde153f5b service neutron] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:32.154146 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e99385-0505-4c4d-8319-0a7dde153f5b service neutron] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:32.154416 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e99385-0505-4c4d-8319-0a7dde153f5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:32.163371 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e99385-0505-4c4d-8319-0a7dde153f5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:55:32.164830 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e99385-0505-4c4d-8319-0a7dde153f5b service neutron] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:55:32.174966 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 536/1072] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:55:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:55:34.629663 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874cd51d-4d4b-4a56-9192-f3df6170b0b7 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:34.630189 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874cd51d-4d4b-4a56-9192-f3df6170b0b7 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:34.630189 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874cd51d-4d4b-4a56-9192-f3df6170b0b7 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:34.631519 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 537/1073] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 11:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:55:34.636836 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b12ab-f757-44ea-bc2c-33f0117bf866 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:34.637240 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b12ab-f757-44ea-bc2c-33f0117bf866 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:34.637401 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b12ab-f757-44ea-bc2c-33f0117bf866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:34.657717 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-f34b12ab-f757-44ea-bc2c-33f0117bf866 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:55:34.658896 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-f34b12ab-f757-44ea-bc2c-33f0117bf866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:55:34.666835 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 537/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 11:55:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:55:35.021791 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874cd51d-4d4b-4a56-9192-f3df6170b0b7 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:55:35.033066 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874cd51d-4d4b-4a56-9192-f3df6170b0b7 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:55:35.036575 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36fe54-92c6-4fba-81d2-d7800d48fded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:55:35.037208 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36fe54-92c6-4fba-81d2-d7800d48fded service neutron] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:35.037662 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36fe54-92c6-4fba-81d2-d7800d48fded service neutron] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:35.038158 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36fe54-92c6-4fba-81d2-d7800d48fded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:35.047085 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36fe54-92c6-4fba-81d2-d7800d48fded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:55:35.048514 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36fe54-92c6-4fba-81d2-d7800d48fded service neutron] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:55:35.057440 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 538/1075] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:55:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:55:37.504240 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05388e3c-e153-41a1-ac97-529a49798f40 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:37.504770 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05388e3c-e153-41a1-ac97-529a49798f40 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:37.504770 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05388e3c-e153-41a1-ac97-529a49798f40 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:37.506001 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 538/1076] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 11:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:55:37.511432 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c65b0f-e9a8-4fcc-9d82-102e7985b225 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:37.511869 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c65b0f-e9a8-4fcc-9d82-102e7985b225 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:37.511976 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c65b0f-e9a8-4fcc-9d82-102e7985b225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:37.531784 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-51c65b0f-e9a8-4fcc-9d82-102e7985b225 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:55:37.533123 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-51c65b0f-e9a8-4fcc-9d82-102e7985b225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:55:37.540646 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 539/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 11:55:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:55:37.880028 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05388e3c-e153-41a1-ac97-529a49798f40 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:55:37.890992 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05388e3c-e153-41a1-ac97-529a49798f40 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:55:37.894474 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca201e29-6833-425e-9070-b8c69f3378aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:55:37.895048 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca201e29-6833-425e-9070-b8c69f3378aa service neutron] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:37.895315 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca201e29-6833-425e-9070-b8c69f3378aa service neutron] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:37.895579 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca201e29-6833-425e-9070-b8c69f3378aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:37.904208 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca201e29-6833-425e-9070-b8c69f3378aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:55:37.905613 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca201e29-6833-425e-9070-b8c69f3378aa service neutron] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:55:37.914613 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 539/1078] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:55:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:55:40.442141 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e67c03-c137-4fae-9dde-bfafc4f22505 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:40.442715 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e67c03-c137-4fae-9dde-bfafc4f22505 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:40.442715 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e67c03-c137-4fae-9dde-bfafc4f22505 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:40.444057 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 540/1079] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 11:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:55:40.449203 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503af30-d637-4bf9-83e5-3aa63a024730 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:40.449612 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503af30-d637-4bf9-83e5-3aa63a024730 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:40.449723 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503af30-d637-4bf9-83e5-3aa63a024730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:40.468540 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-f503af30-d637-4bf9-83e5-3aa63a024730 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:55:40.469705 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-f503af30-d637-4bf9-83e5-3aa63a024730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:55:40.477378 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 540/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 11:55:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:55:40.821456 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e67c03-c137-4fae-9dde-bfafc4f22505 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:55:40.832598 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e67c03-c137-4fae-9dde-bfafc4f22505 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:55:40.836062 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb09e5-cb8d-49bd-ad42-b41d4123b297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:55:40.836646 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb09e5-cb8d-49bd-ad42-b41d4123b297 service neutron] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:40.836921 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb09e5-cb8d-49bd-ad42-b41d4123b297 service neutron] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:40.837192 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb09e5-cb8d-49bd-ad42-b41d4123b297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:40.845762 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cb09e5-cb8d-49bd-ad42-b41d4123b297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:55:40.847168 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cb09e5-cb8d-49bd-ad42-b41d4123b297 service neutron] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:55:40.856258 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 541/1081] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:55:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:55:43.260622 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6f706-0f83-4f68-83f8-26441cd77850 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:43.261195 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6f706-0f83-4f68-83f8-26441cd77850 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:43.261195 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6f706-0f83-4f68-83f8-26441cd77850 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:43.262475 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 541/1082] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 11:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:55:43.267838 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fa055-240e-4f09-8e25-3274ea6638ea None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:43.268306 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fa055-240e-4f09-8e25-3274ea6638ea None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:43.268419 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fa055-240e-4f09-8e25-3274ea6638ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:43.287216 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-b21fa055-240e-4f09-8e25-3274ea6638ea None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:55:43.288529 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-b21fa055-240e-4f09-8e25-3274ea6638ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:55:43.296956 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 542/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 11:55:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:55:43.630803 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6f706-0f83-4f68-83f8-26441cd77850 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:55:43.641571 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6f706-0f83-4f68-83f8-26441cd77850 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:55:43.644974 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d528d-5290-467d-b2d7-3f284f9d2275 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:55:43.645574 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d528d-5290-467d-b2d7-3f284f9d2275 service neutron] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:43.645843 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d528d-5290-467d-b2d7-3f284f9d2275 service neutron] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:43.646104 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d528d-5290-467d-b2d7-3f284f9d2275 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:43.654692 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d528d-5290-467d-b2d7-3f284f9d2275 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:55:43.656676 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d528d-5290-467d-b2d7-3f284f9d2275 service neutron] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:55:43.660390 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=52 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:55:43.666650 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 542/1084] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:55:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:55:46.072754 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1283c6-bab3-4c4d-b641-3f46ef2c618c None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:46.073348 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1283c6-bab3-4c4d-b641-3f46ef2c618c None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:46.073348 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1283c6-bab3-4c4d-b641-3f46ef2c618c None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:46.074611 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 543/1085] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 11:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:55:46.080414 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaaafb0-3eba-41d3-92e9-7436faa8a22e None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:46.080860 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaaafb0-3eba-41d3-92e9-7436faa8a22e None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:46.080966 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaaafb0-3eba-41d3-92e9-7436faa8a22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:46.099381 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-cfaaafb0-3eba-41d3-92e9-7436faa8a22e None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:55:46.100571 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-cfaaafb0-3eba-41d3-92e9-7436faa8a22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:55:46.108147 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 543/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 11:55:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:55:46.443803 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1283c6-bab3-4c4d-b641-3f46ef2c618c None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:55:46.455264 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1283c6-bab3-4c4d-b641-3f46ef2c618c None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:55:46.458867 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae5a0c-4cea-46b8-b0b7-993101f5e625 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:55:46.459446 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae5a0c-4cea-46b8-b0b7-993101f5e625 service neutron] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:55:46.459718 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae5a0c-4cea-46b8-b0b7-993101f5e625 service neutron] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:55:46.459981 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae5a0c-4cea-46b8-b0b7-993101f5e625 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:55:46.469261 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae5a0c-4cea-46b8-b0b7-993101f5e625 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:55:46.470665 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae5a0c-4cea-46b8-b0b7-993101f5e625 service neutron] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:55:46.480198 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 544/1087] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:55:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:55:56.094640 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=4 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:55:56.475723 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=26 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:56:10.855336 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c43c89-1354-44a2-bb6b-e316896c64ed None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:56:10.855902 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c43c89-1354-44a2-bb6b-e316896c64ed None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:56:10.855902 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c43c89-1354-44a2-bb6b-e316896c64ed None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:56:10.857142 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 544/1088] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:56:10.862842 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570dc7a5-5634-4a7d-b901-6ba5e21200a7 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:56:10.863295 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570dc7a5-5634-4a7d-b901-6ba5e21200a7 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:56:10.863398 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570dc7a5-5634-4a7d-b901-6ba5e21200a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:56:10.882095 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-570dc7a5-5634-4a7d-b901-6ba5e21200a7 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:56:10.883280 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-570dc7a5-5634-4a7d-b901-6ba5e21200a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:56:10.890922 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 545/1089] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:56:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:56:11.245310 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b62a4-f261-4f36-a5a3-c7b968348983 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:56:11.245586 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b62a4-f261-4f36-a5a3-c7b968348983 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:56:11.245887 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b62a4-f261-4f36-a5a3-c7b968348983 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:56:11.247227 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 545/1090] 10.222.0.27 () {54 vars in 962 bytes} [Wed Sep 21 11:56:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:56:11.252494 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83f31b-ccde-4eb1-9134-702b90914d60 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:56:11.252780 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83f31b-ccde-4eb1-9134-702b90914d60 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:56:11.253056 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83f31b-ccde-4eb1-9134-702b90914d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:56:11.272569 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-9f83f31b-ccde-4eb1-9134-702b90914d60 None None] MFA Rules not processed for user `f4e6b7bc6eea49ba9f54b0305f3173b0`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:56:11.273749 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-9f83f31b-ccde-4eb1-9134-702b90914d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:56:11.280014 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 546/1091] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Sep 21 11:56:11 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:56:11.287929 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b62a4-f261-4f36-a5a3-c7b968348983 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:56:11.299720 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b62a4-f261-4f36-a5a3-c7b968348983 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:56:11.303329 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afee74-94ec-4c86-8762-099f2135a4a4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e6b7bc6eea49ba9f54b0305f3173b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:56:11.303897 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afee74-94ec-4c86-8762-099f2135a4a4 service glance] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:56:11.304203 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afee74-94ec-4c86-8762-099f2135a4a4 service glance] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:56:11.304469 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afee74-94ec-4c86-8762-099f2135a4a4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:56:11.313156 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68afee74-94ec-4c86-8762-099f2135a4a4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:56:11.314566 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68afee74-94ec-4c86-8762-099f2135a4a4 service glance] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:56:11.323854 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 546/1092] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:56:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:56:13.809573 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ace83-1d16-481b-821f-9342859f3a31 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:56:13.810110 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ace83-1d16-481b-821f-9342859f3a31 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:56:13.810110 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ace83-1d16-481b-821f-9342859f3a31 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:56:13.811347 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 547/1093] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:56:13.816972 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616c946-1866-4f5e-ae30-3fc2a46be5db None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:56:13.817431 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616c946-1866-4f5e-ae30-3fc2a46be5db None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:56:13.817536 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616c946-1866-4f5e-ae30-3fc2a46be5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:56:13.836604 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-a616c946-1866-4f5e-ae30-3fc2a46be5db None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:56:13.837765 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-a616c946-1866-4f5e-ae30-3fc2a46be5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:56:13.845257 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 547/1094] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:56:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:56:14.165822 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ace83-1d16-481b-821f-9342859f3a31 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:56:14.178584 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ace83-1d16-481b-821f-9342859f3a31 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:56:14.182952 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37254013-292f-48b2-8212-f97b02a5a952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:56:14.183530 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37254013-292f-48b2-8212-f97b02a5a952 admin admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:56:14.183802 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37254013-292f-48b2-8212-f97b02a5a952 admin admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:56:14.184099 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37254013-292f-48b2-8212-f97b02a5a952 admin admin] PATH_INFO: `/v3/projects` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:56:14.184752 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37254013-292f-48b2-8212-f97b02a5a952 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:56:14.186494 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: WARNING py.warnings [None req-37254013-292f-48b2-8212-f97b02a5a952 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 11:56:14.186494 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: warnings.warn(msg) Sep 21 11:56:14.186494 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: Sep 21 11:56:14.187630 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37254013-292f-48b2-8212-f97b02a5a952 admin admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:56:14.206751 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 548/1095] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 11:56:14 2022] GET /identity/v3/projects => generated 1606 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 11:56:16.591549 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3694d-d784-40c7-991d-8c32bd50997b None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:56:16.592054 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3694d-d784-40c7-991d-8c32bd50997b None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:56:16.592164 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3694d-d784-40c7-991d-8c32bd50997b None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:56:16.594112 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 548/1096] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:56:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:56:16.599516 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99075f-dccc-4d9a-96ed-523275f143db None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:56:16.599953 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99075f-dccc-4d9a-96ed-523275f143db None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:56:16.600116 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99075f-dccc-4d9a-96ed-523275f143db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:56:16.618761 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-0d99075f-dccc-4d9a-96ed-523275f143db None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:56:16.619928 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-0d99075f-dccc-4d9a-96ed-523275f143db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:56:16.629858 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 549/1097] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:56:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:56:16.977059 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3694d-d784-40c7-991d-8c32bd50997b None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:56:16.990795 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3694d-d784-40c7-991d-8c32bd50997b None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:56:16.995615 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26562bf-a899-49b6-8d77-355c1e85b357 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c683dcd33e5b40fabbbf12c3dcf97eb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:56:16.996223 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26562bf-a899-49b6-8d77-355c1e85b357 service nova] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:56:16.996498 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26562bf-a899-49b6-8d77-355c1e85b357 service nova] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:56:16.996763 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26562bf-a899-49b6-8d77-355c1e85b357 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:56:17.005269 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26562bf-a899-49b6-8d77-355c1e85b357 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:56:17.006839 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26562bf-a899-49b6-8d77-355c1e85b357 service nova] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:56:17.016497 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 549/1098] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:56:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:56:19.586372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9a4ba-eb7b-4f8e-aefc-4933b91aa9b4 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:56:19.586770 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9a4ba-eb7b-4f8e-aefc-4933b91aa9b4 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:56:19.586911 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9a4ba-eb7b-4f8e-aefc-4933b91aa9b4 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:56:19.588281 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 550/1099] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:56:19.594040 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b971e-38d2-4912-9758-4917d25147bb None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:56:19.594469 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b971e-38d2-4912-9758-4917d25147bb None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:56:19.594572 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b971e-38d2-4912-9758-4917d25147bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:56:19.613030 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-613b971e-38d2-4912-9758-4917d25147bb None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:56:19.614199 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-613b971e-38d2-4912-9758-4917d25147bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:56:19.621753 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 550/1100] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:56:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:56:19.964233 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9a4ba-eb7b-4f8e-aefc-4933b91aa9b4 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:56:19.974784 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9a4ba-eb7b-4f8e-aefc-4933b91aa9b4 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:56:19.978319 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206e55e-bcaa-429b-ad6f-fe9c34339273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:56:19.978896 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206e55e-bcaa-429b-ad6f-fe9c34339273 service neutron] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:56:19.979174 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206e55e-bcaa-429b-ad6f-fe9c34339273 service neutron] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:56:19.979496 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206e55e-bcaa-429b-ad6f-fe9c34339273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:56:19.988856 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206e55e-bcaa-429b-ad6f-fe9c34339273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:56:19.990275 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206e55e-bcaa-429b-ad6f-fe9c34339273 service neutron] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:56:20.000139 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 551/1101] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:56:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:56:22.435368 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d291a13-83ba-41dd-86a9-512455b2fa38 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:56:22.436013 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d291a13-83ba-41dd-86a9-512455b2fa38 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:56:22.436013 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d291a13-83ba-41dd-86a9-512455b2fa38 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:56:22.437281 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 551/1102] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:56:22.442357 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a52fa2-f2ce-4ca1-bb4a-9dcbc4b64965 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:56:22.442813 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a52fa2-f2ce-4ca1-bb4a-9dcbc4b64965 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:56:22.442922 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a52fa2-f2ce-4ca1-bb4a-9dcbc4b64965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:56:22.462431 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-63a52fa2-f2ce-4ca1-bb4a-9dcbc4b64965 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:56:22.463612 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-63a52fa2-f2ce-4ca1-bb4a-9dcbc4b64965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:56:22.471875 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 552/1103] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:56:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:56:22.816325 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d291a13-83ba-41dd-86a9-512455b2fa38 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:56:22.826844 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d291a13-83ba-41dd-86a9-512455b2fa38 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:56:22.830916 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da420b5b-66f3-4850-ba79-440a49075200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:56:22.831492 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da420b5b-66f3-4850-ba79-440a49075200 service neutron] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:56:22.831762 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da420b5b-66f3-4850-ba79-440a49075200 service neutron] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:56:22.832049 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da420b5b-66f3-4850-ba79-440a49075200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:56:22.840707 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da420b5b-66f3-4850-ba79-440a49075200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:56:22.842159 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da420b5b-66f3-4850-ba79-440a49075200 service neutron] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:56:22.851358 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 552/1104] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:56:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:56:25.415946 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6244cee-dd43-4de9-8014-6f407cc0c59e None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:56:25.416444 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6244cee-dd43-4de9-8014-6f407cc0c59e None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:56:25.416542 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6244cee-dd43-4de9-8014-6f407cc0c59e None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:56:25.417840 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 553/1105] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:56:25.423903 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e05dbe-0055-4174-88a7-90ccb264f90b None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:56:25.424486 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e05dbe-0055-4174-88a7-90ccb264f90b None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:56:25.424486 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e05dbe-0055-4174-88a7-90ccb264f90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:56:25.444085 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-b4e05dbe-0055-4174-88a7-90ccb264f90b None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:56:25.445272 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-b4e05dbe-0055-4174-88a7-90ccb264f90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:56:25.452877 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 553/1106] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:56:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:56:25.790349 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6244cee-dd43-4de9-8014-6f407cc0c59e None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:56:25.801827 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6244cee-dd43-4de9-8014-6f407cc0c59e None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:56:25.805313 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a3a10-4331-4c59-8f9c-92cab67e93c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:56:25.805892 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a3a10-4331-4c59-8f9c-92cab67e93c1 service neutron] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:56:25.806167 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a3a10-4331-4c59-8f9c-92cab67e93c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:56:25.806438 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a3a10-4331-4c59-8f9c-92cab67e93c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:56:25.815515 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a3a10-4331-4c59-8f9c-92cab67e93c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:56:25.817035 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a3a10-4331-4c59-8f9c-92cab67e93c1 service neutron] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:56:25.826221 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 554/1107] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:56:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:56:28.434345 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e16a1-a792-45df-8390-542cc7ad8483 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:56:28.434905 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e16a1-a792-45df-8390-542cc7ad8483 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:56:28.434905 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e16a1-a792-45df-8390-542cc7ad8483 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:56:28.436314 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 554/1108] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 11:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:56:28.442015 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ece2f2-de9f-4ce2-ba8c-5a43236264d8 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:56:28.442450 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ece2f2-de9f-4ce2-ba8c-5a43236264d8 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:56:28.442560 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ece2f2-de9f-4ce2-ba8c-5a43236264d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:56:28.461440 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-d2ece2f2-de9f-4ce2-ba8c-5a43236264d8 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:56:28.462618 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-d2ece2f2-de9f-4ce2-ba8c-5a43236264d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:56:28.470206 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 555/1109] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 11:56:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:56:28.819110 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e16a1-a792-45df-8390-542cc7ad8483 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:56:28.830447 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e16a1-a792-45df-8390-542cc7ad8483 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:56:28.833898 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4f699-5677-4c5d-9824-c3c9ab585160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:56:28.834470 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4f699-5677-4c5d-9824-c3c9ab585160 service neutron] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:56:28.834740 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4f699-5677-4c5d-9824-c3c9ab585160 service neutron] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:56:28.835004 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4f699-5677-4c5d-9824-c3c9ab585160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:56:28.843635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4f699-5677-4c5d-9824-c3c9ab585160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:56:28.845036 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4f699-5677-4c5d-9824-c3c9ab585160 service neutron] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:56:28.854062 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 555/1110] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:56:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:56:38.456625 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=33 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:56:38.850136 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=33 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:57:43.838100 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ede8be-2fa9-49ba-a65d-de37201c5a58 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:57:43.838685 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ede8be-2fa9-49ba-a65d-de37201c5a58 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:57:43.838685 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ede8be-2fa9-49ba-a65d-de37201c5a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:57:43.857692 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-a5ede8be-2fa9-49ba-a65d-de37201c5a58 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:57:43.858861 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-a5ede8be-2fa9-49ba-a65d-de37201c5a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:57:43.866392 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 556/1111] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 11:57:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 11:57:43.874069 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655507ea-e754-4649-8438-368b4c099c74 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:57:43.874624 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655507ea-e754-4649-8438-368b4c099c74 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:57:43.874624 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655507ea-e754-4649-8438-368b4c099c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:57:43.894894 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-655507ea-e754-4649-8438-368b4c099c74 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:57:43.896180 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-655507ea-e754-4649-8438-368b4c099c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:57:43.904050 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 556/1112] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 11:57:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:57:43.908415 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ede8be-2fa9-49ba-a65d-de37201c5a58 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:57:43.917689 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ede8be-2fa9-49ba-a65d-de37201c5a58 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:57:43.922197 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b820d1-7bec-45d4-ad71-aed70c756a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:57:43.923050 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b820d1-7bec-45d4-ad71-aed70c756a6d admin admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:57:43.923382 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b820d1-7bec-45d4-ad71-aed70c756a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:57:43.923651 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b820d1-7bec-45d4-ad71-aed70c756a6d admin admin] PATH_INFO: `/v3/domains` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:57:43.924328 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b820d1-7bec-45d4-ad71-aed70c756a6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 11:57:43.924629 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b820d1-7bec-45d4-ad71-aed70c756a6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:57:43.925631 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: WARNING py.warnings [None req-c1b820d1-7bec-45d4-ad71-aed70c756a6d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 21 11:57:43.925631 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: warnings.warn(msg) Sep 21 11:57:43.925631 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: Sep 21 11:57:43.926561 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b820d1-7bec-45d4-ad71-aed70c756a6d admin admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:57:43.938035 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 557/1113] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 11:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:57:43.946315 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655507ea-e754-4649-8438-368b4c099c74 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:57:43.955891 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655507ea-e754-4649-8438-368b4c099c74 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:57:43.960551 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231bf7b-fb08-4258-85ce-eb5b28460796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:57:43.961133 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231bf7b-fb08-4258-85ce-eb5b28460796 admin admin] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:57:43.961408 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231bf7b-fb08-4258-85ce-eb5b28460796 admin admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:57:43.961678 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231bf7b-fb08-4258-85ce-eb5b28460796 admin admin] PATH_INFO: `/v3/projects` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:57:43.962308 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d231bf7b-fb08-4258-85ce-eb5b28460796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:57:43.964101 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: WARNING py.warnings [None req-d231bf7b-fb08-4258-85ce-eb5b28460796 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 11:57:43.964101 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: warnings.warn(msg) Sep 21 11:57:43.964101 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: Sep 21 11:57:43.965287 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d231bf7b-fb08-4258-85ce-eb5b28460796 admin admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:57:43.992750 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 557/1114] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 11:57:43 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 11:57:43.997147 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b820d1-7bec-45d4-ad71-aed70c756a6d admin admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:57:44.007649 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b820d1-7bec-45d4-ad71-aed70c756a6d admin admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:57:44.061648 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be43ea-c629-48b9-ad34-6b6f7b55d699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:57:44.062234 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be43ea-c629-48b9-ad34-6b6f7b55d699 admin admin] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:57:44.062531 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be43ea-c629-48b9-ad34-6b6f7b55d699 admin admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:57:44.062784 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be43ea-c629-48b9-ad34-6b6f7b55d699 admin admin] PATH_INFO: `/v3/users` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:57:44.063408 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be43ea-c629-48b9-ad34-6b6f7b55d699 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:57:44.065035 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: WARNING py.warnings [None req-b9be43ea-c629-48b9-ad34-6b6f7b55d699 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 11:57:44.065035 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: warnings.warn(msg) Sep 21 11:57:44.065035 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: Sep 21 11:57:44.066241 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be43ea-c629-48b9-ad34-6b6f7b55d699 admin admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:57:44.087036 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 558/1115] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 11:57:43 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 11:57:44.091247 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231bf7b-fb08-4258-85ce-eb5b28460796 admin admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:57:44.101336 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231bf7b-fb08-4258-85ce-eb5b28460796 admin admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:57:44.105844 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d7dc4-e486-4fed-a2c3-c3e8744aee80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:57:44.106425 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d7dc4-e486-4fed-a2c3-c3e8744aee80 admin admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:57:44.106699 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d7dc4-e486-4fed-a2c3-c3e8744aee80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:57:44.106969 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d7dc4-e486-4fed-a2c3-c3e8744aee80 admin admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:57:44.107594 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d7dc4-e486-4fed-a2c3-c3e8744aee80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:57:44.108641 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: WARNING py.warnings [None req-529d7dc4-e486-4fed-a2c3-c3e8744aee80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 21 11:57:44.108641 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: warnings.warn(msg) Sep 21 11:57:44.108641 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: Sep 21 11:57:44.109519 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d7dc4-e486-4fed-a2c3-c3e8744aee80 admin admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:57:44.122369 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 558/1116] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 11:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 11:57:44.126208 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be43ea-c629-48b9-ad34-6b6f7b55d699 admin admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:57:44.136484 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be43ea-c629-48b9-ad34-6b6f7b55d699 admin admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:57:44.140948 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd5045-6aac-4899-bf4b-802631cd7b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:57:44.141528 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd5045-6aac-4899-bf4b-802631cd7b3c admin admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:57:44.141804 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd5045-6aac-4899-bf4b-802631cd7b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:57:44.142074 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd5045-6aac-4899-bf4b-802631cd7b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:57:44.142697 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd5045-6aac-4899-bf4b-802631cd7b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:57:44.143679 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: WARNING py.warnings [None req-4fbd5045-6aac-4899-bf4b-802631cd7b3c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 21 11:57:44.143679 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: warnings.warn(msg) Sep 21 11:57:44.143679 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: Sep 21 11:57:44.144657 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd5045-6aac-4899-bf4b-802631cd7b3c admin admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:57:44.157437 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 559/1117] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 11:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 11:57:44.161341 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d7dc4-e486-4fed-a2c3-c3e8744aee80 admin admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:57:44.170939 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d7dc4-e486-4fed-a2c3-c3e8744aee80 admin admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:57:44.177739 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df23fcf-3d0a-442e-b45e-0d2055957aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:57:44.178386 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df23fcf-3d0a-442e-b45e-0d2055957aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:57:44.178668 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df23fcf-3d0a-442e-b45e-0d2055957aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:57:44.178939 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df23fcf-3d0a-442e-b45e-0d2055957aa0 admin admin] PATH_INFO: `/v3/projects/ef674baba2ef4750bc1ec7bdbd741755/users/e5f752332b3440228bf26fecac562246/roles/165db5ccce0540569e708b81df7a5577` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:57:44.194361 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df23fcf-3d0a-442e-b45e-0d2055957aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef674baba2ef4750bc1ec7bdbd741755, user_id=e5f752332b3440228bf26fecac562246, role_id=165db5ccce0540569e708b81df7a5577)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:57:44.195383 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: WARNING py.warnings [None req-6df23fcf-3d0a-442e-b45e-0d2055957aa0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 11:57:44.195383 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: warnings.warn(msg) Sep 21 11:57:44.195383 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: Sep 21 11:57:44.197360 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df23fcf-3d0a-442e-b45e-0d2055957aa0 admin admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:57:44.210262 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 559/1118] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 11:57:44 2022] PUT /identity/v3/projects/ef674baba2ef4750bc1ec7bdbd741755/users/e5f752332b3440228bf26fecac562246/roles/165db5ccce0540569e708b81df7a5577 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 11:57:44.222376 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e3c1a-2656-449d-990d-424dee45bd41 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:57:44.222666 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e3c1a-2656-449d-990d-424dee45bd41 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:57:44.222943 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e3c1a-2656-449d-990d-424dee45bd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:57:44.250683 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-0c7e3c1a-2656-449d-990d-424dee45bd41 None None] MFA Rules not processed for user `e5f752332b3440228bf26fecac562246`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:57:44.252560 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-0c7e3c1a-2656-449d-990d-424dee45bd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:57:44.318407 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 560/1119] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 11:57:44 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:57:44.331404 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f695b8-edc7-4f4c-83e0-0b752ba17dee None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:57:44.331691 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f695b8-edc7-4f4c-83e0-0b752ba17dee None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:57:44.331961 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f695b8-edc7-4f4c-83e0-0b752ba17dee None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:57:44.333323 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 560/1120] 10.222.0.27 () {54 vars in 962 bytes} [Wed Sep 21 11:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:57:44.338153 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5f408-fd95-400e-9118-2d74be030301 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:57:44.338430 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5f408-fd95-400e-9118-2d74be030301 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:57:44.338697 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5f408-fd95-400e-9118-2d74be030301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:57:44.357925 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-b2a5f408-fd95-400e-9118-2d74be030301 None None] MFA Rules not processed for user `75426336bd2d443fbe3f2dd97293fc15`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:57:44.359004 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-b2a5f408-fd95-400e-9118-2d74be030301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:57:44.403512 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:57:44.412327 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 561/1121] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Sep 21 11:57:44 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:57:44.421827 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f695b8-edc7-4f4c-83e0-0b752ba17dee None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:57:44.433429 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f695b8-edc7-4f4c-83e0-0b752ba17dee None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:57:44.436965 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a94fdc-7d7c-4e10-80c9-bf9afde8c299 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75426336bd2d443fbe3f2dd97293fc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:57:44.437543 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a94fdc-7d7c-4e10-80c9-bf9afde8c299 service cinder] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:57:44.437821 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a94fdc-7d7c-4e10-80c9-bf9afde8c299 service cinder] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:57:44.438092 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a94fdc-7d7c-4e10-80c9-bf9afde8c299 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:57:44.446230 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a94fdc-7d7c-4e10-80c9-bf9afde8c299 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:57:44.447644 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a94fdc-7d7c-4e10-80c9-bf9afde8c299 service cinder] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:57:44.456175 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 561/1122] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:57:44 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:57:44.497091 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd3c07-849a-4d9e-b855-fbbbd9997a1d None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:57:44.497371 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd3c07-849a-4d9e-b855-fbbbd9997a1d None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:57:44.497642 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd3c07-849a-4d9e-b855-fbbbd9997a1d None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:57:44.498868 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 562/1123] 10.222.0.27 () {52 vars in 830 bytes} [Wed Sep 21 11:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 11:57:44.502330 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a94fdc-7d7c-4e10-80c9-bf9afde8c299 service cinder] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:57:44.563049 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a94fdc-7d7c-4e10-80c9-bf9afde8c299 service cinder] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:57:44.568259 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259c3de-44fa-4991-ba2f-211ee3473c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:57:44.568876 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259c3de-44fa-4991-ba2f-211ee3473c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:57:44.569152 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259c3de-44fa-4991-ba2f-211ee3473c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:57:44.569424 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259c3de-44fa-4991-ba2f-211ee3473c8a admin admin] PATH_INFO: `/v3/users/e5f752332b3440228bf26fecac562246` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:57:44.570543 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259c3de-44fa-4991-ba2f-211ee3473c8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5f752332b3440228bf26fecac562246)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:57:44.571555 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: WARNING py.warnings [None req-2259c3de-44fa-4991-ba2f-211ee3473c8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 11:57:44.571555 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: warnings.warn(msg) Sep 21 11:57:44.571555 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: Sep 21 11:57:44.572800 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259c3de-44fa-4991-ba2f-211ee3473c8a admin admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:57:44.642030 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [None req-2259c3de-44fa-4991-ba2f-211ee3473c8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5f752332b3440228bf26fecac562246'} {{(pid=88124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 11:57:44.642860 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [None req-2259c3de-44fa-4991-ba2f-211ee3473c8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5f752332b3440228bf26fecac562246'} {{(pid=88124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 11:57:44.654672 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [None req-2259c3de-44fa-4991-ba2f-211ee3473c8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5f752332b3440228bf26fecac562246'} {{(pid=88124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 11:57:44.655386 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [None req-2259c3de-44fa-4991-ba2f-211ee3473c8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5f752332b3440228bf26fecac562246'} {{(pid=88124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 11:57:44.679246 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [None req-2259c3de-44fa-4991-ba2f-211ee3473c8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5f752332b3440228bf26fecac562246'} {{(pid=88124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 11:57:44.698223 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 562/1124] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 11:57:44 2022] DELETE /identity/v3/users/e5f752332b3440228bf26fecac562246 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 11:57:44.702873 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ad53c-9f85-457b-b8ed-dd03ba7b58ff None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:57:44.703153 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ad53c-9f85-457b-b8ed-dd03ba7b58ff None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:57:44.703425 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ad53c-9f85-457b-b8ed-dd03ba7b58ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:57:44.723025 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-8f6ad53c-9f85-457b-b8ed-dd03ba7b58ff None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:57:44.724238 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-8f6ad53c-9f85-457b-b8ed-dd03ba7b58ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:57:44.782101 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 563/1125] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 11:57:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:57:44.792390 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259c3de-44fa-4991-ba2f-211ee3473c8a admin admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:57:44.793802 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-2259c3de-44fa-4991-ba2f-211ee3473c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:57:44.802328 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:57:44.853344 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259c3de-44fa-4991-ba2f-211ee3473c8a admin admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:57:44.856949 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539602ba-5175-484c-a439-48d1fb98b686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:57:44.857549 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539602ba-5175-484c-a439-48d1fb98b686 service neutron] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:57:44.857825 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539602ba-5175-484c-a439-48d1fb98b686 service neutron] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:57:44.858094 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539602ba-5175-484c-a439-48d1fb98b686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:57:44.866902 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539602ba-5175-484c-a439-48d1fb98b686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:57:44.868373 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539602ba-5175-484c-a439-48d1fb98b686 service neutron] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:57:44.877559 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 563/1126] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:57:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:57:45.223392 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ad53c-9f85-457b-b8ed-dd03ba7b58ff None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:57:45.224893 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-8f6ad53c-9f85-457b-b8ed-dd03ba7b58ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:57:45.236820 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ad53c-9f85-457b-b8ed-dd03ba7b58ff None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:57:45.241563 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cb5b3-36af-4d34-98ed-5288b97e7743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:57:45.242705 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cb5b3-36af-4d34-98ed-5288b97e7743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:57:45.243621 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cb5b3-36af-4d34-98ed-5288b97e7743 admin admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:57:45.243887 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cb5b3-36af-4d34-98ed-5288b97e7743 admin admin] PATH_INFO: `/v3/projects/ef674baba2ef4750bc1ec7bdbd741755` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:57:45.245074 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338cb5b3-36af-4d34-98ed-5288b97e7743 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef674baba2ef4750bc1ec7bdbd741755)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:57:45.246067 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: WARNING py.warnings [None req-338cb5b3-36af-4d34-98ed-5288b97e7743 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 11:57:45.246067 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: warnings.warn(msg) Sep 21 11:57:45.246067 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: Sep 21 11:57:45.248648 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338cb5b3-36af-4d34-98ed-5288b97e7743 admin admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:57:45.309435 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [None req-338cb5b3-36af-4d34-98ed-5288b97e7743 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef674baba2ef4750bc1ec7bdbd741755', 'request_id': 'req-338cb5b3-36af-4d34-98ed-5288b97e7743'} {{(pid=88125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 11:57:45.323129 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [None req-338cb5b3-36af-4d34-98ed-5288b97e7743 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef674baba2ef4750bc1ec7bdbd741755', 'request_id': 'req-338cb5b3-36af-4d34-98ed-5288b97e7743'} {{(pid=88125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 11:57:45.332926 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [None req-338cb5b3-36af-4d34-98ed-5288b97e7743 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef674baba2ef4750bc1ec7bdbd741755', 'request_id': 'req-338cb5b3-36af-4d34-98ed-5288b97e7743'} {{(pid=88125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 11:57:45.343975 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [None req-338cb5b3-36af-4d34-98ed-5288b97e7743 admin admin] The token cache is being invalidate because project ef674baba2ef4750bc1ec7bdbd741755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 11:57:45.344293 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [None req-338cb5b3-36af-4d34-98ed-5288b97e7743 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 11:57:45.344915 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [None req-338cb5b3-36af-4d34-98ed-5288b97e7743 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 11:57:45.347215 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 564/1127] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 11:57:45 2022] DELETE /identity/v3/projects/ef674baba2ef4750bc1ec7bdbd741755 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 11:57:54.873510 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=25 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:57:55.341038 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:59:07.110427 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11cfa8-76d6-4dbd-874d-5a8889786f17 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:59:07.111030 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11cfa8-76d6-4dbd-874d-5a8889786f17 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:59:07.111030 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11cfa8-76d6-4dbd-874d-5a8889786f17 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:59:07.112369 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 564/1128] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 11:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:59:07.118009 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310451a7-fb69-4e1c-be1f-353fef66bca5 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:59:07.118453 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310451a7-fb69-4e1c-be1f-353fef66bca5 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:59:07.118571 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310451a7-fb69-4e1c-be1f-353fef66bca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:59:07.192193 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-310451a7-fb69-4e1c-be1f-353fef66bca5 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:59:07.194152 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-310451a7-fb69-4e1c-be1f-353fef66bca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:59:07.290208 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 565/1129] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 11:59:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:59:07.450634 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11cfa8-76d6-4dbd-874d-5a8889786f17 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:59:07.452337 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-8b11cfa8-76d6-4dbd-874d-5a8889786f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:59:07.539654 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11cfa8-76d6-4dbd-874d-5a8889786f17 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:59:07.544533 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65462f-f4e0-49c8-b035-30e790a92823 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c683dcd33e5b40fabbbf12c3dcf97eb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:59:07.545965 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65462f-f4e0-49c8-b035-30e790a92823 service nova] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:59:07.545965 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65462f-f4e0-49c8-b035-30e790a92823 service nova] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:59:07.545965 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65462f-f4e0-49c8-b035-30e790a92823 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:59:07.554653 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b65462f-f4e0-49c8-b035-30e790a92823 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:59:07.556245 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b65462f-f4e0-49c8-b035-30e790a92823 service nova] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:59:07.565389 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 565/1130] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:59:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:59:09.209689 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad80399-18ad-4cd8-8b2a-1ac2e7075c99 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:59:09.210256 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad80399-18ad-4cd8-8b2a-1ac2e7075c99 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:59:09.210256 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad80399-18ad-4cd8-8b2a-1ac2e7075c99 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:59:09.211569 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 566/1131] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 11:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:59:09.216304 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a7dd1-eef5-4603-a72a-a8c1143bfbc6 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:59:09.216766 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a7dd1-eef5-4603-a72a-a8c1143bfbc6 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:59:09.216883 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a7dd1-eef5-4603-a72a-a8c1143bfbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:59:09.236576 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-4d2a7dd1-eef5-4603-a72a-a8c1143bfbc6 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:59:09.237740 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-4d2a7dd1-eef5-4603-a72a-a8c1143bfbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:59:09.246204 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 566/1132] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 11:59:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:59:09.401999 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad80399-18ad-4cd8-8b2a-1ac2e7075c99 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:59:09.417733 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad80399-18ad-4cd8-8b2a-1ac2e7075c99 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:59:09.422778 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b85a6c-6042-4e5d-8db1-7cbc0b943b8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c683dcd33e5b40fabbbf12c3dcf97eb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:59:09.423355 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b85a6c-6042-4e5d-8db1-7cbc0b943b8c service nova] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:59:09.423627 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b85a6c-6042-4e5d-8db1-7cbc0b943b8c service nova] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:59:09.423893 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b85a6c-6042-4e5d-8db1-7cbc0b943b8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:59:09.431757 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b85a6c-6042-4e5d-8db1-7cbc0b943b8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:59:09.433408 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b85a6c-6042-4e5d-8db1-7cbc0b943b8c service nova] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:59:09.442320 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 567/1133] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:59:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:59:12.659339 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6404190-2e4e-49ca-a477-e698b54e1e2d None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:59:12.659890 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6404190-2e4e-49ca-a477-e698b54e1e2d None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:59:12.659890 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6404190-2e4e-49ca-a477-e698b54e1e2d None None] PATH_INFO: `/v3` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:59:12.661161 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 567/1134] 10.222.0.25 () {54 vars in 925 bytes} [Wed Sep 21 11:59:12 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 11:59:12.677046 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300824e8-4b3c-4b1e-ab05-bf48c8ee085b None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:59:12.677479 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300824e8-4b3c-4b1e-ab05-bf48c8ee085b None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:59:12.677595 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300824e8-4b3c-4b1e-ab05-bf48c8ee085b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:59:12.707401 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-300824e8-4b3c-4b1e-ab05-bf48c8ee085b None None] MFA Rules not processed for user `c58b4f9b474c492984a08198cb7df0a0`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:59:12.708632 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-300824e8-4b3c-4b1e-ab05-bf48c8ee085b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:59:12.763733 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=100 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:59:12.773682 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 568/1135] 10.222.0.25 () {58 vars in 1015 bytes} [Wed Sep 21 11:59:12 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:59:16.732344 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcee7d-4ca5-4c7a-8554-093a82db1570 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:59:16.732777 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcee7d-4ca5-4c7a-8554-093a82db1570 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:59:16.732909 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcee7d-4ca5-4c7a-8554-093a82db1570 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:59:16.734352 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 568/1136] 10.222.0.27 () {54 vars in 961 bytes} [Wed Sep 21 11:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:59:16.741011 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ab0ee-1a8f-44cd-a870-3d41d002f581 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:59:16.741443 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ab0ee-1a8f-44cd-a870-3d41d002f581 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:59:16.741538 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ab0ee-1a8f-44cd-a870-3d41d002f581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:59:16.760406 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-989ab0ee-1a8f-44cd-a870-3d41d002f581 None None] MFA Rules not processed for user `c58b4f9b474c492984a08198cb7df0a0`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:59:16.761567 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-989ab0ee-1a8f-44cd-a870-3d41d002f581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:59:16.769902 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 569/1137] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Sep 21 11:59:16 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:59:16.777088 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bcee7d-4ca5-4c7a-8554-093a82db1570 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:59:16.790716 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bcee7d-4ca5-4c7a-8554-093a82db1570 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:59:16.795525 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87ff93-973e-4105-86bb-e3aeee19a6c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c58b4f9b474c492984a08198cb7df0a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:59:16.796131 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87ff93-973e-4105-86bb-e3aeee19a6c9 service placement] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:59:16.796666 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87ff93-973e-4105-86bb-e3aeee19a6c9 service placement] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:59:16.796930 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87ff93-973e-4105-86bb-e3aeee19a6c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:59:16.805518 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87ff93-973e-4105-86bb-e3aeee19a6c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:59:16.807076 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87ff93-973e-4105-86bb-e3aeee19a6c9 service placement] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:59:16.816392 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 569/1138] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:59:16 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:59:21.499127 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8814e-6c8f-4fa4-af1a-ddadf272b200 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:59:21.499558 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8814e-6c8f-4fa4-af1a-ddadf272b200 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:59:21.499655 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8814e-6c8f-4fa4-af1a-ddadf272b200 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:59:21.501008 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 570/1139] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 11:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:59:21.505709 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4f3ab-2862-4009-bae7-1740f2d9d5c4 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:59:21.506239 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4f3ab-2862-4009-bae7-1740f2d9d5c4 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:59:21.506239 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4f3ab-2862-4009-bae7-1740f2d9d5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:59:21.526214 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-cfc4f3ab-2862-4009-bae7-1740f2d9d5c4 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:59:21.527393 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-cfc4f3ab-2862-4009-bae7-1740f2d9d5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:59:21.535123 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 570/1140] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 11:59:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:59:21.699001 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8814e-6c8f-4fa4-af1a-ddadf272b200 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:59:21.713279 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8814e-6c8f-4fa4-af1a-ddadf272b200 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:59:21.718128 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3746779-b92d-40ca-a751-6a1a4664c2ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c683dcd33e5b40fabbbf12c3dcf97eb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:59:21.718708 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3746779-b92d-40ca-a751-6a1a4664c2ee service nova] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:59:21.718981 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3746779-b92d-40ca-a751-6a1a4664c2ee service nova] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:59:21.719247 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3746779-b92d-40ca-a751-6a1a4664c2ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:59:21.727269 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3746779-b92d-40ca-a751-6a1a4664c2ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:59:21.728871 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3746779-b92d-40ca-a751-6a1a4664c2ee service nova] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:59:21.738026 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 571/1141] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:59:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:59:23.348506 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04342815-0b54-47d2-81ab-e50219b1996b None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:59:23.349078 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04342815-0b54-47d2-81ab-e50219b1996b None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:59:23.349078 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04342815-0b54-47d2-81ab-e50219b1996b None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:59:23.350382 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 571/1142] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 11:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:59:23.355195 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16a297-0ec4-4d46-934e-28fe11c1892a None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:59:23.355622 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16a297-0ec4-4d46-934e-28fe11c1892a None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:59:23.355783 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16a297-0ec4-4d46-934e-28fe11c1892a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:59:23.374942 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-ae16a297-0ec4-4d46-934e-28fe11c1892a None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:59:23.376179 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-ae16a297-0ec4-4d46-934e-28fe11c1892a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:59:23.384494 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 572/1143] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 11:59:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:59:23.541870 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04342815-0b54-47d2-81ab-e50219b1996b None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:59:23.558207 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04342815-0b54-47d2-81ab-e50219b1996b None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:59:23.563074 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a81f7-a840-45c1-b126-420c7120a6c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c683dcd33e5b40fabbbf12c3dcf97eb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:59:23.563656 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a81f7-a840-45c1-b126-420c7120a6c2 service nova] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:59:23.563937 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a81f7-a840-45c1-b126-420c7120a6c2 service nova] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:59:23.564228 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a81f7-a840-45c1-b126-420c7120a6c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:59:23.572705 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a81f7-a840-45c1-b126-420c7120a6c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:59:23.574283 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a81f7-a840-45c1-b126-420c7120a6c2 service nova] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:59:23.583669 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 572/1144] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:59:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:59:27.905327 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdb946-2ddc-4204-974d-a03259bdc413 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:59:27.906019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdb946-2ddc-4204-974d-a03259bdc413 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:59:27.906019 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdb946-2ddc-4204-974d-a03259bdc413 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:59:27.907194 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 573/1145] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 11:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:59:27.912347 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ed971-f615-4371-82ca-51b26361310d None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:59:27.913344 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ed971-f615-4371-82ca-51b26361310d None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:59:27.913457 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ed971-f615-4371-82ca-51b26361310d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:59:27.933286 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-1c2ed971-f615-4371-82ca-51b26361310d None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:59:27.934450 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-1c2ed971-f615-4371-82ca-51b26361310d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:59:27.942062 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 573/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 11:59:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:59:28.278559 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bdb946-2ddc-4204-974d-a03259bdc413 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:59:28.280316 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-85bdb946-2ddc-4204-974d-a03259bdc413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:59:28.338330 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bdb946-2ddc-4204-974d-a03259bdc413 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:59:28.341785 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513da7d-9857-43a2-9479-0dbdfb9289b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:59:28.342372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513da7d-9857-43a2-9479-0dbdfb9289b8 service neutron] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:59:28.342647 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513da7d-9857-43a2-9479-0dbdfb9289b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:59:28.342914 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513da7d-9857-43a2-9479-0dbdfb9289b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:59:28.352319 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513da7d-9857-43a2-9479-0dbdfb9289b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:59:28.353737 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513da7d-9857-43a2-9479-0dbdfb9289b8 service neutron] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:59:28.363231 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 574/1147] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:59:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:59:30.739056 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ec735-fc77-40b5-b840-05fa09824d68 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:59:30.739639 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ec735-fc77-40b5-b840-05fa09824d68 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:59:30.739639 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ec735-fc77-40b5-b840-05fa09824d68 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:59:30.740965 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 574/1148] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 11:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:59:30.746041 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889db775-c8a5-48dd-a77f-99b80047567c None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:59:30.746477 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889db775-c8a5-48dd-a77f-99b80047567c None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:59:30.746582 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889db775-c8a5-48dd-a77f-99b80047567c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:59:30.766534 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-889db775-c8a5-48dd-a77f-99b80047567c None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:59:30.767714 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-889db775-c8a5-48dd-a77f-99b80047567c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:59:30.775899 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 575/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 11:59:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:59:31.109353 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ec735-fc77-40b5-b840-05fa09824d68 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:59:31.120350 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ec735-fc77-40b5-b840-05fa09824d68 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:59:31.123711 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec57273-503c-41e4-8aea-d40bc7a49ed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:59:31.124323 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec57273-503c-41e4-8aea-d40bc7a49ed7 service neutron] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:59:31.124589 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec57273-503c-41e4-8aea-d40bc7a49ed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:59:31.124849 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec57273-503c-41e4-8aea-d40bc7a49ed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:59:31.134109 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec57273-503c-41e4-8aea-d40bc7a49ed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:59:31.135535 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec57273-503c-41e4-8aea-d40bc7a49ed7 service neutron] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:59:31.144752 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 575/1150] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:59:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:59:34.971689 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc0e53-b8e4-48ad-b2cd-91c04e1f04db None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:59:34.972306 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc0e53-b8e4-48ad-b2cd-91c04e1f04db None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:59:34.972306 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc0e53-b8e4-48ad-b2cd-91c04e1f04db None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:59:34.973587 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 576/1151] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 11:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:59:34.979471 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3c328-31eb-4f16-a88c-d005b9bb509d None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:59:34.979878 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3c328-31eb-4f16-a88c-d005b9bb509d None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:59:34.980040 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3c328-31eb-4f16-a88c-d005b9bb509d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:59:34.987393 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=67 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:59:34.999930 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-9bc3c328-31eb-4f16-a88c-d005b9bb509d None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:59:35.001131 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-9bc3c328-31eb-4f16-a88c-d005b9bb509d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:59:35.008821 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 576/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 11:59:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:59:35.369765 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc0e53-b8e4-48ad-b2cd-91c04e1f04db None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:59:35.371432 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-bdfc0e53-b8e4-48ad-b2cd-91c04e1f04db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:59:35.436416 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc0e53-b8e4-48ad-b2cd-91c04e1f04db None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:59:35.439823 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb42589-690d-4406-9655-52f70bfacdb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75426336bd2d443fbe3f2dd97293fc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:59:35.440446 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb42589-690d-4406-9655-52f70bfacdb7 service cinder] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:59:35.440719 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb42589-690d-4406-9655-52f70bfacdb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:59:35.440983 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb42589-690d-4406-9655-52f70bfacdb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:59:35.449575 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb42589-690d-4406-9655-52f70bfacdb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:59:35.450975 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb42589-690d-4406-9655-52f70bfacdb7 service cinder] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:59:35.459956 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 577/1153] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:59:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:59:37.874395 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e966487-f818-4eae-9c96-efc0ded8d42d None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:59:37.874926 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e966487-f818-4eae-9c96-efc0ded8d42d None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:59:37.874926 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e966487-f818-4eae-9c96-efc0ded8d42d None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:59:37.876303 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 577/1154] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 11:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 11:59:37.881412 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9aad4-f361-4f72-b57c-2acb4d6fc2d3 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:59:37.881845 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9aad4-f361-4f72-b57c-2acb4d6fc2d3 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:59:37.881956 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9aad4-f361-4f72-b57c-2acb4d6fc2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:59:37.901500 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-cac9aad4-f361-4f72-b57c-2acb4d6fc2d3 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 11:59:37.902667 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-cac9aad4-f361-4f72-b57c-2acb4d6fc2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:59:37.910259 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 578/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 11:59:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 11:59:38.269944 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e966487-f818-4eae-9c96-efc0ded8d42d None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 11:59:38.271635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-7e966487-f818-4eae-9c96-efc0ded8d42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 11:59:38.285244 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e966487-f818-4eae-9c96-efc0ded8d42d None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 11:59:38.288747 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121d7aa-03b9-4f21-8de7-6cdbdd11ce9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75426336bd2d443fbe3f2dd97293fc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 11:59:38.289325 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121d7aa-03b9-4f21-8de7-6cdbdd11ce9c service cinder] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 11:59:38.289598 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121d7aa-03b9-4f21-8de7-6cdbdd11ce9c service cinder] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 11:59:38.289866 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121d7aa-03b9-4f21-8de7-6cdbdd11ce9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 11:59:38.299595 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121d7aa-03b9-4f21-8de7-6cdbdd11ce9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 11:59:38.301109 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121d7aa-03b9-4f21-8de7-6cdbdd11ce9c service cinder] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 11:59:38.310926 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 578/1156] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 11:59:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 11:59:47.895615 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=70 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 11:59:48.306438 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=8 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:00:53.275302 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4666e79-50a7-407a-b477-6739b50c4b99 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:00:53.275962 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4666e79-50a7-407a-b477-6739b50c4b99 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:00:53.275962 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4666e79-50a7-407a-b477-6739b50c4b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:00:53.294979 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-b4666e79-50a7-407a-b477-6739b50c4b99 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:00:53.295919 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43030c1a-341a-4458-b6f0-0feb9bbbcd7f None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:00:53.296449 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43030c1a-341a-4458-b6f0-0feb9bbbcd7f None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:00:53.296559 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-b4666e79-50a7-407a-b477-6739b50c4b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:00:53.296676 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43030c1a-341a-4458-b6f0-0feb9bbbcd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:00:53.304377 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 579/1157] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 12:00:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:00:53.312036 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823de330-9fd8-471e-935d-db306c0047e5 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:00:53.312322 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823de330-9fd8-471e-935d-db306c0047e5 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:00:53.312594 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823de330-9fd8-471e-935d-db306c0047e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:00:53.315449 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-43030c1a-341a-4458-b6f0-0feb9bbbcd7f None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:00:53.316615 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-43030c1a-341a-4458-b6f0-0feb9bbbcd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:00:53.328818 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 579/1158] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 12:00:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:00:53.337321 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e83da8-b332-4bdf-bba7-71e877df6a11 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:00:53.337603 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e83da8-b332-4bdf-bba7-71e877df6a11 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:00:53.337779 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-823de330-9fd8-471e-935d-db306c0047e5 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:00:53.337887 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e83da8-b332-4bdf-bba7-71e877df6a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:00:53.338950 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-823de330-9fd8-471e-935d-db306c0047e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:00:53.348039 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 580/1159] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 12:00:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:00:53.351157 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823de330-9fd8-471e-935d-db306c0047e5 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:00:53.357724 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-79e83da8-b332-4bdf-bba7-71e877df6a11 None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:00:53.358894 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-79e83da8-b332-4bdf-bba7-71e877df6a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:00:53.360291 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823de330-9fd8-471e-935d-db306c0047e5 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:00:53.365095 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b072794-c1b7-4113-8ff2-b7459ea17451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:00:53.365675 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b072794-c1b7-4113-8ff2-b7459ea17451 admin admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:00:53.365952 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b072794-c1b7-4113-8ff2-b7459ea17451 admin admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:00:53.366224 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b072794-c1b7-4113-8ff2-b7459ea17451 admin admin] PATH_INFO: `/v3/domains` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:00:53.366856 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b072794-c1b7-4113-8ff2-b7459ea17451 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:00:53.367192 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 580/1160] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 12:00:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:00:53.367316 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b072794-c1b7-4113-8ff2-b7459ea17451 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:00:53.368828 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b072794-c1b7-4113-8ff2-b7459ea17451 admin admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:00:53.371239 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e83da8-b332-4bdf-bba7-71e877df6a11 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:00:53.381059 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e83da8-b332-4bdf-bba7-71e877df6a11 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:00:53.381346 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 581/1161] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 12:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:00:53.385717 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf7b1f-da1a-455d-a423-71e109faff3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:00:53.386293 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf7b1f-da1a-455d-a423-71e109faff3a admin admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:00:53.386563 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf7b1f-da1a-455d-a423-71e109faff3a admin admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:00:53.386828 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf7b1f-da1a-455d-a423-71e109faff3a admin admin] PATH_INFO: `/v3/domains` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:00:53.387459 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf7b1f-da1a-455d-a423-71e109faff3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:00:53.387753 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf7b1f-da1a-455d-a423-71e109faff3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:00:53.388826 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: WARNING py.warnings [None req-29bf7b1f-da1a-455d-a423-71e109faff3a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 21 12:00:53.388826 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: warnings.warn(msg) Sep 21 12:00:53.388826 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: Sep 21 12:00:53.389126 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b072794-c1b7-4113-8ff2-b7459ea17451 admin admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:00:53.389689 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf7b1f-da1a-455d-a423-71e109faff3a admin admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:00:53.399709 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b072794-c1b7-4113-8ff2-b7459ea17451 admin admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:00:53.408394 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 581/1162] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 12:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:00:53.408527 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61900f-a176-4799-98d7-48c83de72aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:00:53.408527 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61900f-a176-4799-98d7-48c83de72aaa admin admin] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:00:53.408527 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61900f-a176-4799-98d7-48c83de72aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:00:53.408527 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61900f-a176-4799-98d7-48c83de72aaa admin admin] PATH_INFO: `/v3/projects` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:00:53.408917 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee61900f-a176-4799-98d7-48c83de72aaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:00:53.408917 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: WARNING py.warnings [None req-ee61900f-a176-4799-98d7-48c83de72aaa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 12:00:53.408917 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: warnings.warn(msg) Sep 21 12:00:53.408917 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: Sep 21 12:00:53.408917 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee61900f-a176-4799-98d7-48c83de72aaa admin admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:00:53.410573 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf7b1f-da1a-455d-a423-71e109faff3a admin admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:00:53.420274 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf7b1f-da1a-455d-a423-71e109faff3a admin admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:00:53.425064 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187de13-3486-4086-b4b1-fd0b44779b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:00:53.425636 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187de13-3486-4086-b4b1-fd0b44779b60 admin admin] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:00:53.425906 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187de13-3486-4086-b4b1-fd0b44779b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:00:53.426170 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187de13-3486-4086-b4b1-fd0b44779b60 admin admin] PATH_INFO: `/v3/projects` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:00:53.426799 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187de13-3486-4086-b4b1-fd0b44779b60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:00:53.428705 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187de13-3486-4086-b4b1-fd0b44779b60 admin admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:00:53.446189 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 582/1163] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 12:00:53 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:00:53.450689 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61900f-a176-4799-98d7-48c83de72aaa admin admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:00:53.461947 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 582/1164] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 12:00:53 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:00:53.462949 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187de13-3486-4086-b4b1-fd0b44779b60 admin admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:00:53.513971 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61900f-a176-4799-98d7-48c83de72aaa admin admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:00:53.524407 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187de13-3486-4086-b4b1-fd0b44779b60 admin admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:00:53.529069 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aabe79e-72bd-41a3-87cc-711163d50e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:00:53.529666 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabe79e-72bd-41a3-87cc-711163d50e71 admin admin] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:00:53.529869 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabe79e-72bd-41a3-87cc-711163d50e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:00:53.530447 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabe79e-72bd-41a3-87cc-711163d50e71 admin admin] PATH_INFO: `/v3/users` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:00:53.530780 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aabe79e-72bd-41a3-87cc-711163d50e71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:00:53.531861 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: WARNING py.warnings [None req-8aabe79e-72bd-41a3-87cc-711163d50e71 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 12:00:53.531861 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: warnings.warn(msg) Sep 21 12:00:53.531861 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: Sep 21 12:00:53.533030 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aabe79e-72bd-41a3-87cc-711163d50e71 admin admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:00:53.557506 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 583/1165] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 12:00:53 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:00:53.561364 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aabe79e-72bd-41a3-87cc-711163d50e71 admin admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:00:53.573036 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aabe79e-72bd-41a3-87cc-711163d50e71 admin admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:00:53.577580 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af08f7-35bf-4b37-962a-a5412e9989f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:00:53.577763 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e1d54-7ca4-44c2-b32c-4a556002471d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:00:53.578274 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e1d54-7ca4-44c2-b32c-4a556002471d admin admin] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:00:53.578398 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af08f7-35bf-4b37-962a-a5412e9989f5 admin admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:00:53.578597 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e1d54-7ca4-44c2-b32c-4a556002471d admin admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:00:53.578714 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af08f7-35bf-4b37-962a-a5412e9989f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:00:53.578814 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e1d54-7ca4-44c2-b32c-4a556002471d admin admin] PATH_INFO: `/v3/users` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:00:53.578900 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af08f7-35bf-4b37-962a-a5412e9989f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:00:53.579517 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e1d54-7ca4-44c2-b32c-4a556002471d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:00:53.579629 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af08f7-35bf-4b37-962a-a5412e9989f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:00:53.581137 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af08f7-35bf-4b37-962a-a5412e9989f5 admin admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:00:53.581510 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e1d54-7ca4-44c2-b32c-4a556002471d admin admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:00:53.591679 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 584/1166] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 12:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:00:53.595553 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af08f7-35bf-4b37-962a-a5412e9989f5 admin admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:00:53.605249 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 583/1167] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 12:00:53 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:00:53.606662 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af08f7-35bf-4b37-962a-a5412e9989f5 admin admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:00:53.609430 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e1d54-7ca4-44c2-b32c-4a556002471d admin admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:00:53.611414 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7dd638-fb7e-4940-b750-1245d3892cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:00:53.612020 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dd638-fb7e-4940-b750-1245d3892cdc admin admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:00:53.612291 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dd638-fb7e-4940-b750-1245d3892cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:00:53.612556 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dd638-fb7e-4940-b750-1245d3892cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:00:53.613181 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7dd638-fb7e-4940-b750-1245d3892cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:00:53.615291 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7dd638-fb7e-4940-b750-1245d3892cdc admin admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:00:53.619466 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e1d54-7ca4-44c2-b32c-4a556002471d admin admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:00:53.624266 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e4c00-442c-43b6-a44a-b428dd66a146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:00:53.624876 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e4c00-442c-43b6-a44a-b428dd66a146 admin admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:00:53.625151 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e4c00-442c-43b6-a44a-b428dd66a146 admin admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:00:53.625425 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e4c00-442c-43b6-a44a-b428dd66a146 admin admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:00:53.628839 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 585/1168] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 12:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:00:53.628983 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e4c00-442c-43b6-a44a-b428dd66a146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:00:53.628983 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e4c00-442c-43b6-a44a-b428dd66a146 admin admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:00:53.629745 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7dd638-fb7e-4940-b750-1245d3892cdc admin admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:00:53.638865 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 584/1169] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 12:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:00:53.640101 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7dd638-fb7e-4940-b750-1245d3892cdc admin admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:00:53.642483 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e4c00-442c-43b6-a44a-b428dd66a146 admin admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:00:53.645001 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe764d-8e5c-4af8-be4e-210c3c622757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:00:53.645640 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe764d-8e5c-4af8-be4e-210c3c622757 admin admin] REQUEST_METHOD: `PUT` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:00:53.645912 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe764d-8e5c-4af8-be4e-210c3c622757 admin admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:00:53.646184 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe764d-8e5c-4af8-be4e-210c3c622757 admin admin] PATH_INFO: `/v3/projects/9f5f17832bb946a4b2420ec3635dc113/users/6d9323ff65984278bb2ed1665039ba24/roles/165db5ccce0540569e708b81df7a5577` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:00:53.651946 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e4c00-442c-43b6-a44a-b428dd66a146 admin admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:00:53.656718 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a9e4b-728e-4157-bec6-85e1f103389f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:00:53.657290 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a9e4b-728e-4157-bec6-85e1f103389f admin admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:00:53.657563 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a9e4b-728e-4157-bec6-85e1f103389f admin admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:00:53.658106 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a9e4b-728e-4157-bec6-85e1f103389f admin admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:00:53.658447 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a9e4b-728e-4157-bec6-85e1f103389f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:00:53.660039 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a9e4b-728e-4157-bec6-85e1f103389f admin admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:00:53.660658 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe764d-8e5c-4af8-be4e-210c3c622757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f5f17832bb946a4b2420ec3635dc113, user_id=6d9323ff65984278bb2ed1665039ba24, role_id=165db5ccce0540569e708b81df7a5577)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:00:53.663327 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe764d-8e5c-4af8-be4e-210c3c622757 admin admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:00:53.672025 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 585/1170] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 12:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:00:53.676089 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a9e4b-728e-4157-bec6-85e1f103389f admin admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:00:53.683233 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 586/1171] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 12:00:53 2022] PUT /identity/v3/projects/9f5f17832bb946a4b2420ec3635dc113/users/6d9323ff65984278bb2ed1665039ba24/roles/165db5ccce0540569e708b81df7a5577 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:00:53.686272 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a9e4b-728e-4157-bec6-85e1f103389f admin admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:00:53.688080 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc526e-bbe2-41ce-a0c2-48e471991f1b None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:00:53.688371 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc526e-bbe2-41ce-a0c2-48e471991f1b None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:00:53.688647 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc526e-bbe2-41ce-a0c2-48e471991f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:00:53.699984 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:00:53.707590 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-becc526e-bbe2-41ce-a0c2-48e471991f1b None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:00:53.708849 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-becc526e-bbe2-41ce-a0c2-48e471991f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:00:53.744515 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda8631-4071-46ab-9c9c-ab1a156cfa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:00:53.745165 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda8631-4071-46ab-9c9c-ab1a156cfa70 admin admin] REQUEST_METHOD: `PUT` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:00:53.745438 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda8631-4071-46ab-9c9c-ab1a156cfa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:00:53.745706 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda8631-4071-46ab-9c9c-ab1a156cfa70 admin admin] PATH_INFO: `/v3/projects/cbe9a8badf9a4cf4820e943c2f720db1/users/0fc8056593e94b298bf4b96b3cb59441/roles/165db5ccce0540569e708b81df7a5577` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:00:53.756252 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:00:53.761263 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda8631-4071-46ab-9c9c-ab1a156cfa70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbe9a8badf9a4cf4820e943c2f720db1, user_id=0fc8056593e94b298bf4b96b3cb59441, role_id=165db5ccce0540569e708b81df7a5577)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:00:53.762666 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: WARNING py.warnings [None req-cdda8631-4071-46ab-9c9c-ab1a156cfa70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 12:00:53.762666 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: warnings.warn(msg) Sep 21 12:00:53.762666 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: Sep 21 12:00:53.764743 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda8631-4071-46ab-9c9c-ab1a156cfa70 admin admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:00:53.769497 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 587/1172] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 12:00:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:00:53.780116 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc526e-bbe2-41ce-a0c2-48e471991f1b None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:00:53.781355 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 586/1173] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 12:00:53 2022] PUT /identity/v3/projects/cbe9a8badf9a4cf4820e943c2f720db1/users/0fc8056593e94b298bf4b96b3cb59441/roles/165db5ccce0540569e708b81df7a5577 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:00:53.785040 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-becc526e-bbe2-41ce-a0c2-48e471991f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:00:53.786416 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd8581-281e-4b61-bdd4-0c2ec0760f0a None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:00:53.786855 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd8581-281e-4b61-bdd4-0c2ec0760f0a None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:00:53.787141 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd8581-281e-4b61-bdd4-0c2ec0760f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:00:53.806114 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-a9cd8581-281e-4b61-bdd4-0c2ec0760f0a None None] MFA Rules not processed for user `371d9f7c2d964f04b62c347e6b182e88`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:00:53.807340 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-a9cd8581-281e-4b61-bdd4-0c2ec0760f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:00:53.850148 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc526e-bbe2-41ce-a0c2-48e471991f1b None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:00:53.865364 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 587/1174] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 12:00:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:00:53.874854 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd8581-281e-4b61-bdd4-0c2ec0760f0a None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:00:53.900131 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719de04-c8a7-485b-8f93-c943f1490781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:00:53.900739 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719de04-c8a7-485b-8f93-c943f1490781 service neutron] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:00:53.901043 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719de04-c8a7-485b-8f93-c943f1490781 service neutron] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:00:53.901307 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719de04-c8a7-485b-8f93-c943f1490781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:00:53.911544 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719de04-c8a7-485b-8f93-c943f1490781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:00:53.913004 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719de04-c8a7-485b-8f93-c943f1490781 service neutron] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:00:53.922738 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 588/1175] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 12:00:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:00:53.929994 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd8581-281e-4b61-bdd4-0c2ec0760f0a None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:00:53.933618 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c9b52-5c95-451b-a4c4-1776d79542b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:00:53.934213 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c9b52-5c95-451b-a4c4-1776d79542b2 service neutron] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:00:53.934491 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c9b52-5c95-451b-a4c4-1776d79542b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:00:53.934761 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c9b52-5c95-451b-a4c4-1776d79542b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:00:53.944744 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c9b52-5c95-451b-a4c4-1776d79542b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:00:53.946372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c9b52-5c95-451b-a4c4-1776d79542b2 service neutron] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:00:53.956357 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 588/1176] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 12:00:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:00:58.824824 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f843837-4d99-4cb7-83b6-11d6f15d09ac None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:00:58.825431 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f843837-4d99-4cb7-83b6-11d6f15d09ac None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:00:58.825431 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f843837-4d99-4cb7-83b6-11d6f15d09ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:00:58.866205 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-2f843837-4d99-4cb7-83b6-11d6f15d09ac None None] MFA Rules not processed for user `6d9323ff65984278bb2ed1665039ba24`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:00:58.867668 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-2f843837-4d99-4cb7-83b6-11d6f15d09ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:00:58.995258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 589/1177] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 12:00:58 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:00:58.996494 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c9b52-5c95-451b-a4c4-1776d79542b2 service neutron] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:00:59.007615 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c9b52-5c95-451b-a4c4-1776d79542b2 service neutron] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:00:59.018572 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973d1d3-b64a-4844-a63c-3ec0975f9dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:00:59.019317 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973d1d3-b64a-4844-a63c-3ec0975f9dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:00:59.019868 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973d1d3-b64a-4844-a63c-3ec0975f9dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:00:59.020876 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973d1d3-b64a-4844-a63c-3ec0975f9dc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:00:59.021296 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973d1d3-b64a-4844-a63c-3ec0975f9dc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:00:59.031484 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973d1d3-b64a-4844-a63c-3ec0975f9dc0 admin admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:00:59.082075 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 589/1178] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 12:00:58 2022] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:00:59.087016 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f843837-4d99-4cb7-83b6-11d6f15d09ac None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:00:59.105268 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f843837-4d99-4cb7-83b6-11d6f15d09ac None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:00:59.153635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:00:59.209778 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a12a1-fd27-4982-b957-92f2daacff62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:00:59.210985 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a12a1-fd27-4982-b957-92f2daacff62 admin admin] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:00:59.211446 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a12a1-fd27-4982-b957-92f2daacff62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:00:59.211924 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a12a1-fd27-4982-b957-92f2daacff62 admin admin] PATH_INFO: `/v3/users` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:00:59.213003 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a12a1-fd27-4982-b957-92f2daacff62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:00:59.215244 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a12a1-fd27-4982-b957-92f2daacff62 admin admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:00:59.253515 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 590/1179] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 12:00:59 2022] POST /identity/v3/users => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:00:59.255937 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973d1d3-b64a-4844-a63c-3ec0975f9dc0 admin admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:00:59.278939 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973d1d3-b64a-4844-a63c-3ec0975f9dc0 admin admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:00:59.286749 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b740e-e8f7-4509-8f3e-951e6fab4844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:00:59.288957 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b740e-e8f7-4509-8f3e-951e6fab4844 admin admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:00:59.289493 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b740e-e8f7-4509-8f3e-951e6fab4844 admin admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:00:59.289979 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b740e-e8f7-4509-8f3e-951e6fab4844 admin admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:00:59.291918 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b740e-e8f7-4509-8f3e-951e6fab4844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:00:59.294787 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b740e-e8f7-4509-8f3e-951e6fab4844 admin admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:00:59.318224 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 590/1180] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 12:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:00:59.324848 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a12a1-fd27-4982-b957-92f2daacff62 admin admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:00:59.337146 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a12a1-fd27-4982-b957-92f2daacff62 admin admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:00:59.342912 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff94d7-b9dc-46cc-9603-5789123073eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:00:59.344635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff94d7-b9dc-46cc-9603-5789123073eb admin admin] REQUEST_METHOD: `PUT` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:00:59.345364 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff94d7-b9dc-46cc-9603-5789123073eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:00:59.345860 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff94d7-b9dc-46cc-9603-5789123073eb admin admin] PATH_INFO: `/v3/projects/c6525a9e07fd4bc5ad0247a9118365ce/users/3c31e83a56004dd3856ce7392194feba/roles/d1f3d1431da145709a5e9b374f3b403d` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:00:59.370205 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff94d7-b9dc-46cc-9603-5789123073eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6525a9e07fd4bc5ad0247a9118365ce, user_id=3c31e83a56004dd3856ce7392194feba, role_id=d1f3d1431da145709a5e9b374f3b403d)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:00:59.372949 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff94d7-b9dc-46cc-9603-5789123073eb admin admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:00:59.398039 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 591/1181] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 12:00:59 2022] PUT /identity/v3/projects/c6525a9e07fd4bc5ad0247a9118365ce/users/3c31e83a56004dd3856ce7392194feba/roles/d1f3d1431da145709a5e9b374f3b403d => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:00:59.403078 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b740e-e8f7-4509-8f3e-951e6fab4844 admin admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:00:59.417058 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b740e-e8f7-4509-8f3e-951e6fab4844 admin admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:00:59.430202 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:00:59.529374 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008e707-bbac-4e27-b86e-73675791cdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:00:59.530535 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008e707-bbac-4e27-b86e-73675791cdba admin admin] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:00:59.531191 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008e707-bbac-4e27-b86e-73675791cdba admin admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:00:59.538975 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008e707-bbac-4e27-b86e-73675791cdba admin admin] PATH_INFO: `/v3/roles` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:00:59.540107 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a008e707-bbac-4e27-b86e-73675791cdba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:00:59.543519 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a008e707-bbac-4e27-b86e-73675791cdba admin admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:00:59.561221 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 591/1182] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 12:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:00:59.562415 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff94d7-b9dc-46cc-9603-5789123073eb admin admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:00:59.580034 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff94d7-b9dc-46cc-9603-5789123073eb admin admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:00:59.604126 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038f73b-702b-4568-a986-4aba689234f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:00:59.605769 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038f73b-702b-4568-a986-4aba689234f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:00:59.606521 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038f73b-702b-4568-a986-4aba689234f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:00:59.606886 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038f73b-702b-4568-a986-4aba689234f0 admin admin] PATH_INFO: `/v3/projects/c6525a9e07fd4bc5ad0247a9118365ce/users/3c31e83a56004dd3856ce7392194feba/roles/d1f3d1431da145709a5e9b374f3b403d` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:00:59.611694 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038f73b-702b-4568-a986-4aba689234f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6525a9e07fd4bc5ad0247a9118365ce, user_id=3c31e83a56004dd3856ce7392194feba, role_id=d1f3d1431da145709a5e9b374f3b403d)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:00:59.615144 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038f73b-702b-4568-a986-4aba689234f0 admin admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:00:59.658035 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 592/1183] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 12:00:59 2022] PUT /identity/v3/projects/c6525a9e07fd4bc5ad0247a9118365ce/users/3c31e83a56004dd3856ce7392194feba/roles/d1f3d1431da145709a5e9b374f3b403d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:00:59.826042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ee9f6-5a51-44d6-96bb-1d4c751142ad None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:00:59.826571 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ee9f6-5a51-44d6-96bb-1d4c751142ad None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:00:59.826965 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ee9f6-5a51-44d6-96bb-1d4c751142ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:00:59.865842 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-c93ee9f6-5a51-44d6-96bb-1d4c751142ad None None] MFA Rules not processed for user `0fc8056593e94b298bf4b96b3cb59441`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:00:59.867064 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-c93ee9f6-5a51-44d6-96bb-1d4c751142ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:00:59.957590 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 592/1184] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 12:00:59 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:00:59.959753 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038f73b-702b-4568-a986-4aba689234f0 admin admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:01:00.063483 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038f73b-702b-4568-a986-4aba689234f0 admin admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:01:00.072300 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ae919-6683-4376-9c29-ee8f5411009d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:01:00.072987 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ae919-6683-4376-9c29-ee8f5411009d admin admin] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:00.073350 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ae919-6683-4376-9c29-ee8f5411009d admin admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:00.073573 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ae919-6683-4376-9c29-ee8f5411009d admin admin] PATH_INFO: `/v3/projects` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:00.074230 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ae919-6683-4376-9c29-ee8f5411009d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:01:00.076330 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ae919-6683-4376-9c29-ee8f5411009d admin admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:01:00.110330 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 593/1185] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 12:00:59 2022] POST /identity/v3/projects => generated 379 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:01:00.114424 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ee9f6-5a51-44d6-96bb-1d4c751142ad None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:01:00.127064 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ee9f6-5a51-44d6-96bb-1d4c751142ad None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:01:00.202148 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767509c4-c318-459e-97f9-5aa8cdba8b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:01:00.202777 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767509c4-c318-459e-97f9-5aa8cdba8b96 admin admin] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:00.203264 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767509c4-c318-459e-97f9-5aa8cdba8b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:00.203946 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767509c4-c318-459e-97f9-5aa8cdba8b96 admin admin] PATH_INFO: `/v3/users` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:00.204250 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767509c4-c318-459e-97f9-5aa8cdba8b96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:01:00.206856 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767509c4-c318-459e-97f9-5aa8cdba8b96 admin admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:01:00.240908 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 593/1186] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 12:01:00 2022] POST /identity/v3/users => generated 296 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:01:00.242684 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ae919-6683-4376-9c29-ee8f5411009d admin admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:01:00.286846 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ae919-6683-4376-9c29-ee8f5411009d admin admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:01:00.303527 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5681a27-a673-4944-8163-f988b79ce7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:01:00.304422 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5681a27-a673-4944-8163-f988b79ce7b6 admin admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:00.304596 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5681a27-a673-4944-8163-f988b79ce7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:00.304934 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5681a27-a673-4944-8163-f988b79ce7b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:00.305617 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5681a27-a673-4944-8163-f988b79ce7b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:01:00.307393 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5681a27-a673-4944-8163-f988b79ce7b6 admin admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:01:00.319601 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 594/1187] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 12:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:01:00.323796 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767509c4-c318-459e-97f9-5aa8cdba8b96 admin admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:01:00.348314 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767509c4-c318-459e-97f9-5aa8cdba8b96 admin admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:01:00.354814 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23037749-9c39-4dba-a979-77d83d5d6d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:01:00.355649 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23037749-9c39-4dba-a979-77d83d5d6d29 admin admin] REQUEST_METHOD: `PUT` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:00.356078 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23037749-9c39-4dba-a979-77d83d5d6d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:00.356403 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23037749-9c39-4dba-a979-77d83d5d6d29 admin admin] PATH_INFO: `/v3/projects/4c4f01f819d549e0a4753da22a118738/users/e185aebff6764298b18baff8bb6a61c6/roles/d1f3d1431da145709a5e9b374f3b403d` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:00.389547 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23037749-9c39-4dba-a979-77d83d5d6d29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c4f01f819d549e0a4753da22a118738, user_id=e185aebff6764298b18baff8bb6a61c6, role_id=d1f3d1431da145709a5e9b374f3b403d)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:01:00.392878 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23037749-9c39-4dba-a979-77d83d5d6d29 admin admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:01:00.416331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 594/1188] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 12:01:00 2022] PUT /identity/v3/projects/4c4f01f819d549e0a4753da22a118738/users/e185aebff6764298b18baff8bb6a61c6/roles/d1f3d1431da145709a5e9b374f3b403d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:01:00.417952 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5681a27-a673-4944-8163-f988b79ce7b6 admin admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:01:00.433635 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5681a27-a673-4944-8163-f988b79ce7b6 admin admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:01:00.515781 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6546a9-dd54-4ae7-baca-eb90e1cb8f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:01:00.516579 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6546a9-dd54-4ae7-baca-eb90e1cb8f9f admin admin] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:00.516992 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6546a9-dd54-4ae7-baca-eb90e1cb8f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:00.517351 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6546a9-dd54-4ae7-baca-eb90e1cb8f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:00.518141 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6546a9-dd54-4ae7-baca-eb90e1cb8f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:01:00.520674 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6546a9-dd54-4ae7-baca-eb90e1cb8f9f admin admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:01:00.522532 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:01:00.540047 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 595/1189] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 12:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:01:00.544368 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23037749-9c39-4dba-a979-77d83d5d6d29 admin admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:01:00.550448 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:01:00.559478 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23037749-9c39-4dba-a979-77d83d5d6d29 admin admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:01:00.565548 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7163463-cce4-48ca-aeb3-4e139399fbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:01:00.566530 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7163463-cce4-48ca-aeb3-4e139399fbea admin admin] REQUEST_METHOD: `PUT` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:00.566530 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7163463-cce4-48ca-aeb3-4e139399fbea admin admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:00.567747 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7163463-cce4-48ca-aeb3-4e139399fbea admin admin] PATH_INFO: `/v3/projects/4c4f01f819d549e0a4753da22a118738/users/e185aebff6764298b18baff8bb6a61c6/roles/d1f3d1431da145709a5e9b374f3b403d` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:00.570409 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7163463-cce4-48ca-aeb3-4e139399fbea admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c4f01f819d549e0a4753da22a118738, user_id=e185aebff6764298b18baff8bb6a61c6, role_id=d1f3d1431da145709a5e9b374f3b403d)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:01:00.574741 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7163463-cce4-48ca-aeb3-4e139399fbea admin admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:01:00.589470 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 595/1190] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 12:01:00 2022] PUT /identity/v3/projects/4c4f01f819d549e0a4753da22a118738/users/e185aebff6764298b18baff8bb6a61c6/roles/d1f3d1431da145709a5e9b374f3b403d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:01:05.716111 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ede553-731d-48a7-a55d-b3077ff5433c None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:05.716661 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ede553-731d-48a7-a55d-b3077ff5433c None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:05.716661 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ede553-731d-48a7-a55d-b3077ff5433c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:05.753560 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-97ede553-731d-48a7-a55d-b3077ff5433c None None] MFA Rules not processed for user `3c31e83a56004dd3856ce7392194feba`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:01:05.756283 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-97ede553-731d-48a7-a55d-b3077ff5433c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:01:05.891428 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 596/1191] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 12:01:05 2022] POST /identity/v3/auth/tokens => generated 2887 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:01:05.914923 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7163463-cce4-48ca-aeb3-4e139399fbea admin admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:01:05.917125 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-a7163463-cce4-48ca-aeb3-4e139399fbea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:01:06.065456 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7163463-cce4-48ca-aeb3-4e139399fbea admin admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:01:06.078235 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb9b29-0cc9-4b97-b51e-d89fe269e966 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e6b7bc6eea49ba9f54b0305f3173b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:01:06.079127 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb9b29-0cc9-4b97-b51e-d89fe269e966 service glance] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:06.079615 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb9b29-0cc9-4b97-b51e-d89fe269e966 service glance] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:06.080453 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb9b29-0cc9-4b97-b51e-d89fe269e966 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:06.237042 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb9b29-0cc9-4b97-b51e-d89fe269e966 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:01:06.239607 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb9b29-0cc9-4b97-b51e-d89fe269e966 service glance] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:01:06.265403 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 596/1192] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 12:01:05 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:01:06.756723 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5179a-ac38-4e3f-9644-0378d5951996 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:06.758147 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5179a-ac38-4e3f-9644-0378d5951996 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:06.758628 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5179a-ac38-4e3f-9644-0378d5951996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:06.805121 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-9af5179a-ac38-4e3f-9644-0378d5951996 None None] MFA Rules not processed for user `e185aebff6764298b18baff8bb6a61c6`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:01:06.808019 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-9af5179a-ac38-4e3f-9644-0378d5951996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:01:06.925372 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 597/1193] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 12:01:06 2022] POST /identity/v3/auth/tokens => generated 2883 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:01:06.943343 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb9b29-0cc9-4b97-b51e-d89fe269e966 service glance] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:01:06.959637 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb9b29-0cc9-4b97-b51e-d89fe269e966 service glance] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:01:06.970392 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def2539-6486-49e7-b523-6909f117ff68 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e6b7bc6eea49ba9f54b0305f3173b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:01:06.971381 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def2539-6486-49e7-b523-6909f117ff68 service glance] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:06.971874 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def2539-6486-49e7-b523-6909f117ff68 service glance] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:06.978440 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def2539-6486-49e7-b523-6909f117ff68 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:07.087606 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def2539-6486-49e7-b523-6909f117ff68 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:01:07.089385 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def2539-6486-49e7-b523-6909f117ff68 service glance] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:01:07.100408 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 597/1194] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 12:01:06 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:01:14.622631 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9843267-5f51-4718-8e28-104a54c5661a None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:14.623159 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9843267-5f51-4718-8e28-104a54c5661a None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:14.623159 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9843267-5f51-4718-8e28-104a54c5661a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:14.644298 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-c9843267-5f51-4718-8e28-104a54c5661a None None] MFA Rules not processed for user `6d9323ff65984278bb2ed1665039ba24`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:01:14.646057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-c9843267-5f51-4718-8e28-104a54c5661a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:01:14.654678 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 598/1195] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 12:01:14 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:01:14.952642 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee516b89-b12c-4c96-a150-819c32feb5bf None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:14.953847 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee516b89-b12c-4c96-a150-819c32feb5bf None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:14.954326 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee516b89-b12c-4c96-a150-819c32feb5bf None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:14.956262 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 598/1196] 10.222.0.27 () {54 vars in 965 bytes} [Wed Sep 21 12:01:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:01:14.964842 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b998e2-d941-4b6c-a1fc-3a462f646f7e None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:14.965161 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b998e2-d941-4b6c-a1fc-3a462f646f7e None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:14.965379 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b998e2-d941-4b6c-a1fc-3a462f646f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:14.999611 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-f8b998e2-d941-4b6c-a1fc-3a462f646f7e None None] MFA Rules not processed for user `c683dcd33e5b40fabbbf12c3dcf97eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:01:15.000954 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-f8b998e2-d941-4b6c-a1fc-3a462f646f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:01:15.049209 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=100 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:01:15.072834 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 599/1197] 10.222.0.27 () {58 vars in 1062 bytes} [Wed Sep 21 12:01:14 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:01:15.078597 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2672e-145e-410a-9625-624b8d990673 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:15.078859 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2672e-145e-410a-9625-624b8d990673 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:15.079096 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2672e-145e-410a-9625-624b8d990673 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:15.080497 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 599/1198] 10.222.0.27 () {54 vars in 912 bytes} [Wed Sep 21 12:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:01:15.086930 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99430a-d48a-4a6a-a37f-cba5d9fcc075 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:15.087272 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99430a-d48a-4a6a-a37f-cba5d9fcc075 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:15.087479 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99430a-d48a-4a6a-a37f-cba5d9fcc075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:15.110276 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-3c99430a-d48a-4a6a-a37f-cba5d9fcc075 None None] MFA Rules not processed for user `c683dcd33e5b40fabbbf12c3dcf97eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:01:15.111738 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-3c99430a-d48a-4a6a-a37f-cba5d9fcc075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:01:15.120792 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 600/1199] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 21 12:01:15 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:01:15.133878 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2672e-145e-410a-9625-624b8d990673 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:01:15.135716 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-9db2672e-145e-410a-9625-624b8d990673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:01:15.149440 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2672e-145e-410a-9625-624b8d990673 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:01:15.153059 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f0616-f58b-4cee-8228-eff472d34a44 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e6b7bc6eea49ba9f54b0305f3173b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:01:15.153665 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f0616-f58b-4cee-8228-eff472d34a44 service glance] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:15.153934 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f0616-f58b-4cee-8228-eff472d34a44 service glance] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:15.154201 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f0616-f58b-4cee-8228-eff472d34a44 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:15.165143 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22f0616-f58b-4cee-8228-eff472d34a44 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:01:15.166711 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22f0616-f58b-4cee-8228-eff472d34a44 service glance] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:01:15.179087 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 600/1200] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 12:01:15 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:01:15.574524 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d6f15-59f3-403e-98eb-847ce10acf4e None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:15.574901 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d6f15-59f3-403e-98eb-847ce10acf4e None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:15.575178 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d6f15-59f3-403e-98eb-847ce10acf4e None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:15.577469 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 601/1201] 10.222.0.27 () {54 vars in 912 bytes} [Wed Sep 21 12:01:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:01:15.590666 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2946f-224c-4911-a32e-0ccca0196a52 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:15.590947 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2946f-224c-4911-a32e-0ccca0196a52 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:15.591214 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2946f-224c-4911-a32e-0ccca0196a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:15.613271 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-83b2946f-224c-4911-a32e-0ccca0196a52 None None] MFA Rules not processed for user `1cf371d784014c68a9ff4c301dad5ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:01:15.614493 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-83b2946f-224c-4911-a32e-0ccca0196a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:01:15.631833 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:01:15.699526 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 601/1202] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 21 12:01:15 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:01:15.712516 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d6f15-59f3-403e-98eb-847ce10acf4e None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:01:15.728349 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d6f15-59f3-403e-98eb-847ce10acf4e None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:01:15.737281 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b81fb-d806-4729-9570-e2047c06c768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:01:15.737976 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b81fb-d806-4729-9570-e2047c06c768 service neutron] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:15.740666 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b81fb-d806-4729-9570-e2047c06c768 service neutron] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:15.740957 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b81fb-d806-4729-9570-e2047c06c768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:15.763594 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b81fb-d806-4729-9570-e2047c06c768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:01:15.765144 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b81fb-d806-4729-9570-e2047c06c768 service neutron] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:01:15.775309 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 602/1203] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 12:01:15 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:01:16.431347 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdb310-f561-4344-9c62-45e3cb5d2020 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:16.431950 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdb310-f561-4344-9c62-45e3cb5d2020 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:16.431950 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdb310-f561-4344-9c62-45e3cb5d2020 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:16.433479 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 602/1204] 10.222.0.27 () {54 vars in 965 bytes} [Wed Sep 21 12:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:01:16.440869 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b78e70-de07-4d88-8fc6-4bfb7c0814e4 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:16.441150 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b78e70-de07-4d88-8fc6-4bfb7c0814e4 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:16.441421 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b78e70-de07-4d88-8fc6-4bfb7c0814e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:16.465329 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-33b78e70-de07-4d88-8fc6-4bfb7c0814e4 None None] MFA Rules not processed for user `c683dcd33e5b40fabbbf12c3dcf97eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:01:16.467510 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdb310-f561-4344-9c62-45e3cb5d2020 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:01:16.470336 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-33b78e70-de07-4d88-8fc6-4bfb7c0814e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:01:16.482305 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 603/1205] 10.222.0.27 () {58 vars in 1062 bytes} [Wed Sep 21 12:01:16 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:01:16.489182 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801b5ae-3e1c-4360-bf01-e32e15205520 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:16.489458 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801b5ae-3e1c-4360-bf01-e32e15205520 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:16.489726 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801b5ae-3e1c-4360-bf01-e32e15205520 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:16.491314 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 604/1206] 10.222.0.27 () {54 vars in 912 bytes} [Wed Sep 21 12:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:01:16.496869 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1201d8-d08d-4a91-b55f-00eef1380c78 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:16.497142 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1201d8-d08d-4a91-b55f-00eef1380c78 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:16.498024 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1201d8-d08d-4a91-b55f-00eef1380c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:16.539662 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-6b1201d8-d08d-4a91-b55f-00eef1380c78 None None] MFA Rules not processed for user `c683dcd33e5b40fabbbf12c3dcf97eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:01:16.542755 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-6b1201d8-d08d-4a91-b55f-00eef1380c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:01:16.562090 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 605/1207] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 21 12:01:16 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:01:16.580357 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1201d8-d08d-4a91-b55f-00eef1380c78 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:01:16.593780 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1201d8-d08d-4a91-b55f-00eef1380c78 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:01:16.601452 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb33d8-1540-454b-9a17-5ee6c4f3cb72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:01:16.602755 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb33d8-1540-454b-9a17-5ee6c4f3cb72 service neutron] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:16.603653 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb33d8-1540-454b-9a17-5ee6c4f3cb72 service neutron] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:16.604410 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb33d8-1540-454b-9a17-5ee6c4f3cb72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:16.620139 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb33d8-1540-454b-9a17-5ee6c4f3cb72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:01:16.620924 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdb310-f561-4344-9c62-45e3cb5d2020 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:01:16.621665 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb33d8-1540-454b-9a17-5ee6c4f3cb72 service neutron] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:01:16.627022 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11c6c7-c26f-461b-a77a-a964ec8c7f83 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c58b4f9b474c492984a08198cb7df0a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:01:16.627926 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11c6c7-c26f-461b-a77a-a964ec8c7f83 service placement] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:16.628341 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11c6c7-c26f-461b-a77a-a964ec8c7f83 service placement] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:16.628718 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11c6c7-c26f-461b-a77a-a964ec8c7f83 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:16.631457 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-0e11c6c7-c26f-461b-a77a-a964ec8c7f83 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:01:16.635487 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 606/1208] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 12:01:16 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:01:16.647254 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11c6c7-c26f-461b-a77a-a964ec8c7f83 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:01:16.647858 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11c6c7-c26f-461b-a77a-a964ec8c7f83 service placement] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:01:16.659277 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 603/1209] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 12:01:16 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:01:26.628564 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=28 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:01:26.654351 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=47 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:01:26.923499 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda9272-46dd-470b-bd5e-8955d9b6451c None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:26.923801 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda9272-46dd-470b-bd5e-8955d9b6451c None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:26.924202 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda9272-46dd-470b-bd5e-8955d9b6451c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:26.944296 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-ccda9272-46dd-470b-bd5e-8955d9b6451c None None] MFA Rules not processed for user `1cf371d784014c68a9ff4c301dad5ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:01:26.945720 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-ccda9272-46dd-470b-bd5e-8955d9b6451c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:01:26.952201 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 607/1210] 10.222.0.25 () {58 vars in 1015 bytes} [Wed Sep 21 12:01:26 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:01:26.967399 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11c6c7-c26f-461b-a77a-a964ec8c7f83 service placement] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:01:26.976851 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11c6c7-c26f-461b-a77a-a964ec8c7f83 service placement] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:01:26.980524 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25df056-0dee-4700-ba24-dca484074bd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:01:26.981120 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25df056-0dee-4700-ba24-dca484074bd0 service neutron] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:26.981396 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25df056-0dee-4700-ba24-dca484074bd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:26.981667 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25df056-0dee-4700-ba24-dca484074bd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:26.992654 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25df056-0dee-4700-ba24-dca484074bd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:01:26.994667 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25df056-0dee-4700-ba24-dca484074bd0 service neutron] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:01:27.004658 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 604/1211] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 12:01:26 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:01:27.831415 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40673857-2fb6-42a9-9cc3-2110ed5e86d4 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:27.832103 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40673857-2fb6-42a9-9cc3-2110ed5e86d4 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:27.832103 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40673857-2fb6-42a9-9cc3-2110ed5e86d4 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:27.834135 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 608/1212] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 21 12:01:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:01:27.852417 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b4e4e-3476-4a01-a2a9-38d045d909e5 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:27.852969 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b4e4e-3476-4a01-a2a9-38d045d909e5 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:27.853086 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b4e4e-3476-4a01-a2a9-38d045d909e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:27.874499 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-bd0b4e4e-3476-4a01-a2a9-38d045d909e5 None None] MFA Rules not processed for user `c683dcd33e5b40fabbbf12c3dcf97eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:01:27.875839 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-bd0b4e4e-3476-4a01-a2a9-38d045d909e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:01:27.886485 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 605/1213] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 21 12:01:27 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:01:27.927786 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40673857-2fb6-42a9-9cc3-2110ed5e86d4 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:01:27.947197 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40673857-2fb6-42a9-9cc3-2110ed5e86d4 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:01:27.953209 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb38efb-1565-4804-a28a-0653afd9d4be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c683dcd33e5b40fabbbf12c3dcf97eb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:01:27.954046 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb38efb-1565-4804-a28a-0653afd9d4be service nova] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:27.954522 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb38efb-1565-4804-a28a-0653afd9d4be service nova] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:27.955453 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb38efb-1565-4804-a28a-0653afd9d4be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:27.965314 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb38efb-1565-4804-a28a-0653afd9d4be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:01:27.967001 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb38efb-1565-4804-a28a-0653afd9d4be service nova] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:01:27.977791 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 609/1214] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 12:01:27 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:01:34.799145 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b4fe5-78ef-475b-95d9-37019481dbb5 None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:34.799751 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b4fe5-78ef-475b-95d9-37019481dbb5 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:34.799751 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b4fe5-78ef-475b-95d9-37019481dbb5 None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:34.801237 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 606/1215] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 21 12:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:01:34.808765 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3f865-ddc7-4647-8323-d8b069293dca None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:34.809302 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3f865-ddc7-4647-8323-d8b069293dca None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:34.809302 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3f865-ddc7-4647-8323-d8b069293dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:34.830611 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-feb3f865-ddc7-4647-8323-d8b069293dca None None] MFA Rules not processed for user `c683dcd33e5b40fabbbf12c3dcf97eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:01:34.832574 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-feb3f865-ddc7-4647-8323-d8b069293dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:01:34.841759 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 610/1216] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 21 12:01:34 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:01:34.860138 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b4fe5-78ef-475b-95d9-37019481dbb5 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:01:34.884600 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b4fe5-78ef-475b-95d9-37019481dbb5 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:01:34.893298 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf5055-74fc-41aa-bcff-d9354dee8109 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c683dcd33e5b40fabbbf12c3dcf97eb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:01:34.894098 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf5055-74fc-41aa-bcff-d9354dee8109 service nova] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:34.894568 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf5055-74fc-41aa-bcff-d9354dee8109 service nova] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:34.894887 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf5055-74fc-41aa-bcff-d9354dee8109 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:34.925131 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf5055-74fc-41aa-bcff-d9354dee8109 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:01:34.927337 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf5055-74fc-41aa-bcff-d9354dee8109 service nova] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:01:34.937720 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 607/1217] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 12:01:34 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:01:44.824444 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=12 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:01:44.933539 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=15 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:01:46.885455 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3f865-ddc7-4647-8323-d8b069293dca None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:01:46.896983 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3f865-ddc7-4647-8323-d8b069293dca None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:01:46.900918 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0abca0-ee86-4565-9b15-4d7d82f00743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:01:46.901526 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0abca0-ee86-4565-9b15-4d7d82f00743 service neutron] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:46.901790 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0abca0-ee86-4565-9b15-4d7d82f00743 service neutron] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:46.902057 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0abca0-ee86-4565-9b15-4d7d82f00743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:46.912196 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0abca0-ee86-4565-9b15-4d7d82f00743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:01:46.913685 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0abca0-ee86-4565-9b15-4d7d82f00743 service neutron] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:01:46.923285 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 611/1218] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 12:01:46 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:01:48.911901 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57c46c-f217-432b-a196-11c3715e814e None None] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:48.912535 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57c46c-f217-432b-a196-11c3715e814e None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:48.912535 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57c46c-f217-432b-a196-11c3715e814e None None] PATH_INFO: `/` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:48.914233 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 608/1219] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 21 12:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:01:48.919660 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34129ef-af96-4d49-9fa9-a8215f0bc55e None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:48.920778 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34129ef-af96-4d49-9fa9-a8215f0bc55e None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:48.921382 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34129ef-af96-4d49-9fa9-a8215f0bc55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:48.944405 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-c34129ef-af96-4d49-9fa9-a8215f0bc55e None None] MFA Rules not processed for user `c683dcd33e5b40fabbbf12c3dcf97eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:01:48.945915 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-c34129ef-af96-4d49-9fa9-a8215f0bc55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:01:48.956582 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 612/1220] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 21 12:01:48 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:01:48.971940 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57c46c-f217-432b-a196-11c3715e814e None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:01:48.988979 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57c46c-f217-432b-a196-11c3715e814e None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:01:48.996906 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0eef8-8edf-47a9-9e00-5ca014977e31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c683dcd33e5b40fabbbf12c3dcf97eb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:01:48.997593 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0eef8-8edf-47a9-9e00-5ca014977e31 service nova] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:01:48.997946 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0eef8-8edf-47a9-9e00-5ca014977e31 service nova] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:01:48.998331 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0eef8-8edf-47a9-9e00-5ca014977e31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:01:49.009833 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0eef8-8edf-47a9-9e00-5ca014977e31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:01:49.011927 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0eef8-8edf-47a9-9e00-5ca014977e31 service nova] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:01:49.028178 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 609/1221] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 12:01:48 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:01:58.937160 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=9 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:01:59.019091 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=6 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:02:06.878874 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34ebc6-2190-4205-84b1-2f450bc3cd0f None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:02:06.879395 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34ebc6-2190-4205-84b1-2f450bc3cd0f None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:02:06.879490 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34ebc6-2190-4205-84b1-2f450bc3cd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:02:06.898104 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-db34ebc6-2190-4205-84b1-2f450bc3cd0f None None] MFA Rules not processed for user `0fc8056593e94b298bf4b96b3cb59441`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:02:06.899272 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-db34ebc6-2190-4205-84b1-2f450bc3cd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:02:06.906032 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 613/1222] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 12:02:06 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:02:16.892890 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=3 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:02:30.674611 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141ccfe-6026-4cf3-a6f9-8142fbc15645 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:02:30.675092 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141ccfe-6026-4cf3-a6f9-8142fbc15645 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:02:30.675175 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141ccfe-6026-4cf3-a6f9-8142fbc15645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:02:30.693258 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-0141ccfe-6026-4cf3-a6f9-8142fbc15645 None None] MFA Rules not processed for user `0fc8056593e94b298bf4b96b3cb59441`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:02:30.694418 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-0141ccfe-6026-4cf3-a6f9-8142fbc15645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:02:30.701539 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 610/1223] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 12:02:30 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:02:30.969936 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65977d-4dcb-435a-b2d6-ddbaad331489 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:02:30.970430 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65977d-4dcb-435a-b2d6-ddbaad331489 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:02:30.970516 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65977d-4dcb-435a-b2d6-ddbaad331489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:02:30.989454 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-ab65977d-4dcb-435a-b2d6-ddbaad331489 None None] MFA Rules not processed for user `1cf371d784014c68a9ff4c301dad5ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:02:30.990605 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-ab65977d-4dcb-435a-b2d6-ddbaad331489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:02:30.997774 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 614/1224] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 21 12:02:30 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:02:31.009528 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141ccfe-6026-4cf3-a6f9-8142fbc15645 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:02:31.018902 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141ccfe-6026-4cf3-a6f9-8142fbc15645 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:02:31.022442 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb12d8-33d6-4958-a4fe-69699e077c35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:02:31.023035 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb12d8-33d6-4958-a4fe-69699e077c35 service neutron] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:02:31.023310 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb12d8-33d6-4958-a4fe-69699e077c35 service neutron] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:02:31.023580 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb12d8-33d6-4958-a4fe-69699e077c35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:02:31.030738 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb12d8-33d6-4958-a4fe-69699e077c35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:02:31.032198 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb12d8-33d6-4958-a4fe-69699e077c35 service neutron] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:02:31.039806 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 611/1225] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 12:02:31 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:02:40.984316 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=3 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:02:41.037228 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=9 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:02:45.213284 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be0423-69dc-498b-88cb-a5f140c88726 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:02:45.213753 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be0423-69dc-498b-88cb-a5f140c88726 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:02:45.213853 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be0423-69dc-498b-88cb-a5f140c88726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:02:45.232656 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-64be0423-69dc-498b-88cb-a5f140c88726 None None] MFA Rules not processed for user `0fc8056593e94b298bf4b96b3cb59441`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:02:45.233820 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-64be0423-69dc-498b-88cb-a5f140c88726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:02:45.240514 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 615/1226] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 12:02:45 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:02:55.226837 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=3 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:03:41.368841 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bbd4d-622e-4ded-a805-9bff550f57f1 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:03:41.369351 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bbd4d-622e-4ded-a805-9bff550f57f1 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:03:41.369450 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bbd4d-622e-4ded-a805-9bff550f57f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:03:41.388524 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-595bbd4d-622e-4ded-a805-9bff550f57f1 None None] MFA Rules not processed for user `0fc8056593e94b298bf4b96b3cb59441`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:03:41.389711 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-595bbd4d-622e-4ded-a805-9bff550f57f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:03:41.396441 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 612/1227] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 12:03:41 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:03:51.383587 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=3 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:03:54.081515 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be0423-69dc-498b-88cb-a5f140c88726 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:03:54.100498 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be0423-69dc-498b-88cb-a5f140c88726 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:03:54.103984 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780517f-5caf-4b2c-ad05-664dfd553434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:03:54.104582 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780517f-5caf-4b2c-ad05-664dfd553434 service neutron] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:03:54.104853 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780517f-5caf-4b2c-ad05-664dfd553434 service neutron] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:03:54.105118 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780517f-5caf-4b2c-ad05-664dfd553434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:03:54.113732 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780517f-5caf-4b2c-ad05-664dfd553434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:03:54.115134 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780517f-5caf-4b2c-ad05-664dfd553434 service neutron] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:03:54.124216 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 616/1228] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 12:03:54 2022] GET /identity/v3/auth/tokens => generated 2883 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:04:04.120335 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=10 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:04:16.896681 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bbd4d-622e-4ded-a805-9bff550f57f1 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:04:16.918868 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bbd4d-622e-4ded-a805-9bff550f57f1 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:04:16.924768 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785282c3-bb7c-4013-8f0a-b276e36368b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c58b4f9b474c492984a08198cb7df0a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:04:16.925372 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785282c3-bb7c-4013-8f0a-b276e36368b7 service placement] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:04:16.925647 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785282c3-bb7c-4013-8f0a-b276e36368b7 service placement] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:04:16.925916 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785282c3-bb7c-4013-8f0a-b276e36368b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:04:16.935771 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785282c3-bb7c-4013-8f0a-b276e36368b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:04:16.937684 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785282c3-bb7c-4013-8f0a-b276e36368b7 service placement] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:04:16.949196 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 613/1229] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 12:04:16 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:04:26.943873 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=10 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:05:39.240208 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146c3b3-3f94-4d61-b748-76bc69b218f6 None None] REQUEST_METHOD: `POST` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:39.240701 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146c3b3-3f94-4d61-b748-76bc69b218f6 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:39.240797 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146c3b3-3f94-4d61-b748-76bc69b218f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:39.260428 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.auth.core [None req-b146c3b3-3f94-4d61-b748-76bc69b218f6 None None] MFA Rules not processed for user `6d9323ff65984278bb2ed1665039ba24`. Rule list: `[]` (Enabled: `True`). {{(pid=88124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:05:39.261598 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-b146c3b3-3f94-4d61-b748-76bc69b218f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:05:39.268829 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 617/1230] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 12:05:39 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:05:49.255570 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=3 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:05.774471 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564276c-0ad0-47c7-a32a-77555ba0b40a None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:05.775010 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564276c-0ad0-47c7-a32a-77555ba0b40a None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:05.775010 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564276c-0ad0-47c7-a32a-77555ba0b40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:05.799169 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-1564276c-0ad0-47c7-a32a-77555ba0b40a None None] MFA Rules not processed for user `0fc8056593e94b298bf4b96b3cb59441`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:05.799790 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-1564276c-0ad0-47c7-a32a-77555ba0b40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:05.808735 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 614/1231] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 12:06:05 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:06:06.236675 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146c3b3-3f94-4d61-b748-76bc69b218f6 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:06.250747 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146c3b3-3f94-4d61-b748-76bc69b218f6 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:06.256861 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27e8b3-ca6d-4244-a49e-75bc639b5efb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:06.257465 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27e8b3-ca6d-4244-a49e-75bc639b5efb service neutron] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:06.257896 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27e8b3-ca6d-4244-a49e-75bc639b5efb service neutron] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:06.258494 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27e8b3-ca6d-4244-a49e-75bc639b5efb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:06.268130 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb27e8b3-ca6d-4244-a49e-75bc639b5efb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:06.269567 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb27e8b3-ca6d-4244-a49e-75bc639b5efb service neutron] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:06.279849 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 618/1232] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 12:06:06 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:06:07.713411 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564276c-0ad0-47c7-a32a-77555ba0b40a None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:07.737216 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564276c-0ad0-47c7-a32a-77555ba0b40a None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:07.742615 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e8df8-11a6-4dcd-9a9a-57db30fedcec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c683dcd33e5b40fabbbf12c3dcf97eb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:07.743336 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e8df8-11a6-4dcd-9a9a-57db30fedcec service nova] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:07.743710 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e8df8-11a6-4dcd-9a9a-57db30fedcec service nova] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:07.744113 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e8df8-11a6-4dcd-9a9a-57db30fedcec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:07.768731 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e8df8-11a6-4dcd-9a9a-57db30fedcec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:07.770561 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e8df8-11a6-4dcd-9a9a-57db30fedcec service nova] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:07.783661 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 615/1233] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 12:06:07 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:06:15.923234 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27e8b3-ca6d-4244-a49e-75bc639b5efb service neutron] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:15.931734 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27e8b3-ca6d-4244-a49e-75bc639b5efb service neutron] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:15.935343 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a8c91-470e-4591-91c2-00c2c7a1150c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:15.935960 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a8c91-470e-4591-91c2-00c2c7a1150c service neutron] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:15.936258 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a8c91-470e-4591-91c2-00c2c7a1150c service neutron] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:15.936519 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a8c91-470e-4591-91c2-00c2c7a1150c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:15.945605 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a8c91-470e-4591-91c2-00c2c7a1150c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:15.947019 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a8c91-470e-4591-91c2-00c2c7a1150c service neutron] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:15.957269 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 619/1234] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 12:06:15 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:06:17.777260 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=13 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:18.312490 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e8df8-11a6-4dcd-9a9a-57db30fedcec service nova] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:18.321486 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e8df8-11a6-4dcd-9a9a-57db30fedcec service nova] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:18.324966 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f45842-d8f5-4348-8f2d-6d38cf0e55fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:18.325545 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f45842-d8f5-4348-8f2d-6d38cf0e55fe service neutron] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:18.325818 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f45842-d8f5-4348-8f2d-6d38cf0e55fe service neutron] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:18.326086 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f45842-d8f5-4348-8f2d-6d38cf0e55fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:18.336535 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f45842-d8f5-4348-8f2d-6d38cf0e55fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:18.337935 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f45842-d8f5-4348-8f2d-6d38cf0e55fe service neutron] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:18.347593 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 616/1235] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 12:06:18 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:06:25.952723 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=12 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:28.343484 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=6 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:33.754512 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a8c91-470e-4591-91c2-00c2c7a1150c service neutron] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:33.763127 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a8c91-470e-4591-91c2-00c2c7a1150c service neutron] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:33.766614 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c48ea-45a0-4602-85a3-0ea407c1dbdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:33.767758 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c48ea-45a0-4602-85a3-0ea407c1dbdd service neutron] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:33.768077 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c48ea-45a0-4602-85a3-0ea407c1dbdd service neutron] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:33.768342 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c48ea-45a0-4602-85a3-0ea407c1dbdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:33.775478 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c48ea-45a0-4602-85a3-0ea407c1dbdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:33.776962 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c48ea-45a0-4602-85a3-0ea407c1dbdd service neutron] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:33.784989 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 620/1236] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 12:06:33 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:06:43.781468 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=6 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:25.534620 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f45842-d8f5-4348-8f2d-6d38cf0e55fe service neutron] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:25.547730 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f45842-d8f5-4348-8f2d-6d38cf0e55fe service neutron] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:25.553631 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05259b5c-ac8a-47bf-8fb4-d0096b56f171 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c683dcd33e5b40fabbbf12c3dcf97eb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:25.555397 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05259b5c-ac8a-47bf-8fb4-d0096b56f171 service nova] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:25.555799 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05259b5c-ac8a-47bf-8fb4-d0096b56f171 service nova] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:25.558703 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05259b5c-ac8a-47bf-8fb4-d0096b56f171 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:25.569823 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05259b5c-ac8a-47bf-8fb4-d0096b56f171 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:25.571657 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05259b5c-ac8a-47bf-8fb4-d0096b56f171 service nova] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:25.592253 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 617/1237] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 12:07:25 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:07:32.080033 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c48ea-45a0-4602-85a3-0ea407c1dbdd service neutron] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:32.097021 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c48ea-45a0-4602-85a3-0ea407c1dbdd service neutron] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:32.103732 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3064978-0881-4b5c-a61e-222871f1af69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c683dcd33e5b40fabbbf12c3dcf97eb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:32.105008 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3064978-0881-4b5c-a61e-222871f1af69 service nova] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:32.105759 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3064978-0881-4b5c-a61e-222871f1af69 service nova] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:32.106075 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3064978-0881-4b5c-a61e-222871f1af69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:32.123891 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3064978-0881-4b5c-a61e-222871f1af69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:32.126420 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3064978-0881-4b5c-a61e-222871f1af69 service nova] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:32.137749 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 621/1238] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 12:07:32 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:07:33.595241 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05259b5c-ac8a-47bf-8fb4-d0096b56f171 service nova] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:33.604342 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05259b5c-ac8a-47bf-8fb4-d0096b56f171 service nova] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:33.607851 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f949c-54f4-4704-a6b1-6a61f74d0439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:33.608484 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f949c-54f4-4704-a6b1-6a61f74d0439 service neutron] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:33.609303 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f949c-54f4-4704-a6b1-6a61f74d0439 service neutron] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:33.609574 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f949c-54f4-4704-a6b1-6a61f74d0439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:33.680585 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f949c-54f4-4704-a6b1-6a61f74d0439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:33.682027 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f949c-54f4-4704-a6b1-6a61f74d0439 service neutron] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:33.701112 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 618/1239] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 12:07:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:07:37.029798 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441847f-dc6e-4057-a374-0f7a5279bac9 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:37.030357 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441847f-dc6e-4057-a374-0f7a5279bac9 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:37.030357 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441847f-dc6e-4057-a374-0f7a5279bac9 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:37.031807 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 622/1240] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 21 12:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:07:37.058716 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b3b1b-a4a7-4ad4-a706-1e67595e1e38 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:37.059225 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b3b1b-a4a7-4ad4-a706-1e67595e1e38 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:37.059324 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b3b1b-a4a7-4ad4-a706-1e67595e1e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:37.137947 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-a92b3b1b-a4a7-4ad4-a706-1e67595e1e38 None None] MFA Rules not processed for user `c58b4f9b474c492984a08198cb7df0a0`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:37.139214 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-a92b3b1b-a4a7-4ad4-a706-1e67595e1e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:37.148450 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 619/1241] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 21 12:07:37 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:07:37.159287 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441847f-dc6e-4057-a374-0f7a5279bac9 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:37.172685 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441847f-dc6e-4057-a374-0f7a5279bac9 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:37.177475 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae81ba2-c9d1-4c49-a471-6be854a38176 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c58b4f9b474c492984a08198cb7df0a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:37.178058 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae81ba2-c9d1-4c49-a471-6be854a38176 service placement] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:37.178328 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae81ba2-c9d1-4c49-a471-6be854a38176 service placement] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:37.178592 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae81ba2-c9d1-4c49-a471-6be854a38176 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:37.187760 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae81ba2-c9d1-4c49-a471-6be854a38176 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:37.189372 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae81ba2-c9d1-4c49-a471-6be854a38176 service placement] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:37.198877 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 623/1242] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 12:07:37 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:07:40.279814 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b3b1b-a4a7-4ad4-a706-1e67595e1e38 None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:40.292022 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b3b1b-a4a7-4ad4-a706-1e67595e1e38 None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:40.296916 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146c35a-edf7-4621-9667-a2966c05bed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:40.297530 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146c35a-edf7-4621-9667-a2966c05bed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:40.297803 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146c35a-edf7-4621-9667-a2966c05bed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:40.298319 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146c35a-edf7-4621-9667-a2966c05bed5 admin admin] PATH_INFO: `/v3/users/6d9323ff65984278bb2ed1665039ba24` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:40.299425 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146c35a-edf7-4621-9667-a2966c05bed5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d9323ff65984278bb2ed1665039ba24)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:40.300449 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: WARNING py.warnings [None req-f146c35a-edf7-4621-9667-a2966c05bed5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 12:07:40.300449 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: warnings.warn(msg) Sep 21 12:07:40.300449 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: Sep 21 12:07:40.301658 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146c35a-edf7-4621-9667-a2966c05bed5 admin admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:40.364050 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [None req-f146c35a-edf7-4621-9667-a2966c05bed5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d9323ff65984278bb2ed1665039ba24'} {{(pid=88125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:07:40.364693 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [None req-f146c35a-edf7-4621-9667-a2966c05bed5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d9323ff65984278bb2ed1665039ba24'} {{(pid=88125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:07:40.371370 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [None req-f146c35a-edf7-4621-9667-a2966c05bed5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d9323ff65984278bb2ed1665039ba24'} {{(pid=88125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:07:40.382197 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [None req-f146c35a-edf7-4621-9667-a2966c05bed5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d9323ff65984278bb2ed1665039ba24'} {{(pid=88125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:07:40.399823 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [None req-f146c35a-edf7-4621-9667-a2966c05bed5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d9323ff65984278bb2ed1665039ba24'} {{(pid=88125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:07:40.405684 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 620/1243] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 12:07:40 2022] DELETE /identity/v3/users/6d9323ff65984278bb2ed1665039ba24 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:07:40.576812 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae81ba2-c9d1-4c49-a471-6be854a38176 service placement] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:40.587674 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae81ba2-c9d1-4c49-a471-6be854a38176 service placement] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:40.644805 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14321767-351b-4afb-bf8c-edc48b4a4e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:40.645428 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14321767-351b-4afb-bf8c-edc48b4a4e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:40.645703 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14321767-351b-4afb-bf8c-edc48b4a4e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:40.645971 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14321767-351b-4afb-bf8c-edc48b4a4e53 admin admin] PATH_INFO: `/v3/projects/9f5f17832bb946a4b2420ec3635dc113` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:40.647114 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14321767-351b-4afb-bf8c-edc48b4a4e53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f5f17832bb946a4b2420ec3635dc113)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:40.648164 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: WARNING py.warnings [None req-14321767-351b-4afb-bf8c-edc48b4a4e53 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 12:07:40.648164 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: warnings.warn(msg) Sep 21 12:07:40.648164 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: Sep 21 12:07:40.649357 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14321767-351b-4afb-bf8c-edc48b4a4e53 admin admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:40.717447 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [None req-14321767-351b-4afb-bf8c-edc48b4a4e53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f5f17832bb946a4b2420ec3635dc113', 'request_id': 'req-14321767-351b-4afb-bf8c-edc48b4a4e53'} {{(pid=88124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:07:40.731581 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [None req-14321767-351b-4afb-bf8c-edc48b4a4e53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f5f17832bb946a4b2420ec3635dc113', 'request_id': 'req-14321767-351b-4afb-bf8c-edc48b4a4e53'} {{(pid=88124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:07:40.739933 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [None req-14321767-351b-4afb-bf8c-edc48b4a4e53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f5f17832bb946a4b2420ec3635dc113', 'request_id': 'req-14321767-351b-4afb-bf8c-edc48b4a4e53'} {{(pid=88124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:07:40.750589 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [None req-14321767-351b-4afb-bf8c-edc48b4a4e53 admin admin] The token cache is being invalidate because project 9f5f17832bb946a4b2420ec3635dc113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:07:40.750874 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [None req-14321767-351b-4afb-bf8c-edc48b4a4e53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:07:40.751486 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [None req-14321767-351b-4afb-bf8c-edc48b4a4e53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:07:40.752989 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 624/1244] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 12:07:40 2022] DELETE /identity/v3/projects/9f5f17832bb946a4b2420ec3635dc113 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:07:40.757136 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146c35a-edf7-4621-9667-a2966c05bed5 admin admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:40.758522 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-f146c35a-edf7-4621-9667-a2966c05bed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:40.767687 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:40.772188 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146c35a-edf7-4621-9667-a2966c05bed5 admin admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:40.829698 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c40f9-41f1-493d-9e7c-73fcb1120aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:40.830322 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c40f9-41f1-493d-9e7c-73fcb1120aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:40.830603 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c40f9-41f1-493d-9e7c-73fcb1120aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:40.830875 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c40f9-41f1-493d-9e7c-73fcb1120aa9 admin admin] PATH_INFO: `/v3/users/3c31e83a56004dd3856ce7392194feba` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:40.831976 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c40f9-41f1-493d-9e7c-73fcb1120aa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c31e83a56004dd3856ce7392194feba)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:40.833926 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c40f9-41f1-493d-9e7c-73fcb1120aa9 admin admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:40.878363 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [None req-ef9c40f9-41f1-493d-9e7c-73fcb1120aa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c31e83a56004dd3856ce7392194feba'} {{(pid=88125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:07:40.879004 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [None req-ef9c40f9-41f1-493d-9e7c-73fcb1120aa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c31e83a56004dd3856ce7392194feba'} {{(pid=88125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:07:40.886104 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [None req-ef9c40f9-41f1-493d-9e7c-73fcb1120aa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c31e83a56004dd3856ce7392194feba'} {{(pid=88125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:07:40.893433 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [None req-ef9c40f9-41f1-493d-9e7c-73fcb1120aa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c31e83a56004dd3856ce7392194feba'} {{(pid=88125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:07:40.905040 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [None req-ef9c40f9-41f1-493d-9e7c-73fcb1120aa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c31e83a56004dd3856ce7392194feba'} {{(pid=88125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:07:40.911526 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 621/1245] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 12:07:40 2022] DELETE /identity/v3/users/3c31e83a56004dd3856ce7392194feba => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:07:41.088310 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14321767-351b-4afb-bf8c-edc48b4a4e53 admin admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:41.090002 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-14321767-351b-4afb-bf8c-edc48b4a4e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:41.104813 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14321767-351b-4afb-bf8c-edc48b4a4e53 admin admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:41.166748 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e66283-c69f-4590-962b-eada02817253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:41.167365 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e66283-c69f-4590-962b-eada02817253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:41.167644 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e66283-c69f-4590-962b-eada02817253 admin admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:41.167912 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e66283-c69f-4590-962b-eada02817253 admin admin] PATH_INFO: `/v3/projects/c6525a9e07fd4bc5ad0247a9118365ce` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:41.169027 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e66283-c69f-4590-962b-eada02817253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6525a9e07fd4bc5ad0247a9118365ce)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:41.170920 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e66283-c69f-4590-962b-eada02817253 admin admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:41.177297 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:41.220172 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [None req-97e66283-c69f-4590-962b-eada02817253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6525a9e07fd4bc5ad0247a9118365ce', 'request_id': 'req-97e66283-c69f-4590-962b-eada02817253'} {{(pid=88124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:07:41.226448 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [None req-97e66283-c69f-4590-962b-eada02817253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6525a9e07fd4bc5ad0247a9118365ce', 'request_id': 'req-97e66283-c69f-4590-962b-eada02817253'} {{(pid=88124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:07:41.234365 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [None req-97e66283-c69f-4590-962b-eada02817253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6525a9e07fd4bc5ad0247a9118365ce', 'request_id': 'req-97e66283-c69f-4590-962b-eada02817253'} {{(pid=88124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:07:41.244720 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [None req-97e66283-c69f-4590-962b-eada02817253 admin admin] The token cache is being invalidate because project c6525a9e07fd4bc5ad0247a9118365ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:07:41.245001 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [None req-97e66283-c69f-4590-962b-eada02817253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:07:41.245619 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [None req-97e66283-c69f-4590-962b-eada02817253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:07:41.247080 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 625/1246] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 12:07:41 2022] DELETE /identity/v3/projects/c6525a9e07fd4bc5ad0247a9118365ce => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:07:50.908301 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=51,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:51.241836 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:11.719446 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9653e3-65d9-4b96-a9d9-a58de1343399 None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:11.719981 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9653e3-65d9-4b96-a9d9-a58de1343399 None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:11.719981 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9653e3-65d9-4b96-a9d9-a58de1343399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:11.739100 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-2f9653e3-65d9-4b96-a9d9-a58de1343399 None None] MFA Rules not processed for user `0fc8056593e94b298bf4b96b3cb59441`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:08:11.740314 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-2f9653e3-65d9-4b96-a9d9-a58de1343399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:08:11.792790 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 622/1247] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 12:08:11 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:08:21.785774 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=25 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:09:22.966343 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4bedf-0152-421f-9ebd-9919a2197585 None None] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:22.966785 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4bedf-0152-421f-9ebd-9919a2197585 None None] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:22.966884 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4bedf-0152-421f-9ebd-9919a2197585 None None] PATH_INFO: `/` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:22.968229 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 626/1248] 10.222.0.27 () {54 vars in 961 bytes} [Wed Sep 21 12:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:09:22.973057 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cd723-f142-40b7-98a6-135b24cb897e None None] REQUEST_METHOD: `POST` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:22.973511 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cd723-f142-40b7-98a6-135b24cb897e None None] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:22.973610 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cd723-f142-40b7-98a6-135b24cb897e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:23.011611 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.auth.core [None req-569cd723-f142-40b7-98a6-135b24cb897e None None] MFA Rules not processed for user `c58b4f9b474c492984a08198cb7df0a0`. Rule list: `[]` (Enabled: `True`). {{(pid=88125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:09:23.012829 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-569cd723-f142-40b7-98a6-135b24cb897e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:09:23.115568 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 623/1249] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Sep 21 12:09:22 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:09:23.122890 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4bedf-0152-421f-9ebd-9919a2197585 None None] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:09:23.136398 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4bedf-0152-421f-9ebd-9919a2197585 None None] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:09:23.141216 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670fae4-4d61-4922-ad3b-6c0fb01aec52 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c58b4f9b474c492984a08198cb7df0a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:09:23.141794 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670fae4-4d61-4922-ad3b-6c0fb01aec52 service placement] REQUEST_METHOD: `GET` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:23.142070 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670fae4-4d61-4922-ad3b-6c0fb01aec52 service placement] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:23.142339 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670fae4-4d61-4922-ad3b-6c0fb01aec52 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:23.144045 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-5670fae4-4d61-4922-ad3b-6c0fb01aec52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:09:23.155543 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670fae4-4d61-4922-ad3b-6c0fb01aec52 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:09:23.157144 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670fae4-4d61-4922-ad3b-6c0fb01aec52 service placement] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:09:23.166687 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 627/1250] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 12:09:23 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:09:33.113824 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=55 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:09:33.162688 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=6 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:09:50.705786 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569cd723-f142-40b7-98a6-135b24cb897e None None] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:09:50.707261 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-569cd723-f142-40b7-98a6-135b24cb897e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:09:50.763238 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569cd723-f142-40b7-98a6-135b24cb897e None None] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:09:50.766718 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea7949-a043-414d-8a56-cb8da8218234 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf371d784014c68a9ff4c301dad5ca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd87b195f7c46d2a0d621124acce331', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:09:50.767311 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea7949-a043-414d-8a56-cb8da8218234 service neutron] REQUEST_METHOD: `GET` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:50.767587 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea7949-a043-414d-8a56-cb8da8218234 service neutron] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:50.767858 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea7949-a043-414d-8a56-cb8da8218234 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:50.769602 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-8fea7949-a043-414d-8a56-cb8da8218234 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:09:50.853046 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea7949-a043-414d-8a56-cb8da8218234 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:09:50.854466 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea7949-a043-414d-8a56-cb8da8218234 service neutron] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:09:50.863644 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 624/1251] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 12:09:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:09:56.829079 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670fae4-4d61-4922-ad3b-6c0fb01aec52 service placement] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:09:56.830906 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-5670fae4-4d61-4922-ad3b-6c0fb01aec52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:09:56.845075 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670fae4-4d61-4922-ad3b-6c0fb01aec52 service placement] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:09:56.849567 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018894b-adca-4506-a8d2-970eadf5890d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:09:56.850180 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018894b-adca-4506-a8d2-970eadf5890d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:56.850448 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018894b-adca-4506-a8d2-970eadf5890d admin admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:56.850713 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018894b-adca-4506-a8d2-970eadf5890d admin admin] PATH_INFO: `/v3/users/0fc8056593e94b298bf4b96b3cb59441` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:56.851793 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018894b-adca-4506-a8d2-970eadf5890d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fc8056593e94b298bf4b96b3cb59441)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:09:56.853728 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018894b-adca-4506-a8d2-970eadf5890d admin admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:09:56.899826 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [None req-7018894b-adca-4506-a8d2-970eadf5890d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fc8056593e94b298bf4b96b3cb59441'} {{(pid=88124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:09:56.900389 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [None req-7018894b-adca-4506-a8d2-970eadf5890d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fc8056593e94b298bf4b96b3cb59441'} {{(pid=88124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:09:56.907821 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [None req-7018894b-adca-4506-a8d2-970eadf5890d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fc8056593e94b298bf4b96b3cb59441'} {{(pid=88124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:09:56.908455 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [None req-7018894b-adca-4506-a8d2-970eadf5890d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fc8056593e94b298bf4b96b3cb59441'} {{(pid=88124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:09:56.921282 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [None req-7018894b-adca-4506-a8d2-970eadf5890d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fc8056593e94b298bf4b96b3cb59441'} {{(pid=88124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:09:56.933479 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 628/1252] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 12:09:56 2022] DELETE /identity/v3/users/0fc8056593e94b298bf4b96b3cb59441 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:09:57.114208 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea7949-a043-414d-8a56-cb8da8218234 service neutron] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:09:57.124754 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea7949-a043-414d-8a56-cb8da8218234 service neutron] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:09:57.181202 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b2761-348b-4079-9d3d-d1744408c3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:09:57.181763 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b2761-348b-4079-9d3d-d1744408c3c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:57.182041 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b2761-348b-4079-9d3d-d1744408c3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:57.182313 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b2761-348b-4079-9d3d-d1744408c3c7 admin admin] PATH_INFO: `/v3/projects/cbe9a8badf9a4cf4820e943c2f720db1` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:57.183496 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740b2761-348b-4079-9d3d-d1744408c3c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbe9a8badf9a4cf4820e943c2f720db1)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:09:57.185744 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740b2761-348b-4079-9d3d-d1744408c3c7 admin admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:09:57.221161 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:09:57.238951 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [None req-740b2761-348b-4079-9d3d-d1744408c3c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbe9a8badf9a4cf4820e943c2f720db1', 'request_id': 'req-740b2761-348b-4079-9d3d-d1744408c3c7'} {{(pid=88125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:09:57.246322 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [None req-740b2761-348b-4079-9d3d-d1744408c3c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbe9a8badf9a4cf4820e943c2f720db1', 'request_id': 'req-740b2761-348b-4079-9d3d-d1744408c3c7'} {{(pid=88125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:09:57.253038 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [None req-740b2761-348b-4079-9d3d-d1744408c3c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbe9a8badf9a4cf4820e943c2f720db1', 'request_id': 'req-740b2761-348b-4079-9d3d-d1744408c3c7'} {{(pid=88125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:09:57.263215 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [None req-740b2761-348b-4079-9d3d-d1744408c3c7 admin admin] The token cache is being invalidate because project cbe9a8badf9a4cf4820e943c2f720db1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:09:57.263496 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [None req-740b2761-348b-4079-9d3d-d1744408c3c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:09:57.264140 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [None req-740b2761-348b-4079-9d3d-d1744408c3c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:09:57.265603 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 625/1253] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 12:09:57 2022] DELETE /identity/v3/projects/cbe9a8badf9a4cf4820e943c2f720db1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:09:57.269521 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018894b-adca-4506-a8d2-970eadf5890d admin admin] Authenticating user token {{(pid=88124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:09:57.270910 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.fernet_utils [None req-7018894b-adca-4506-a8d2-970eadf5890d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:09:57.284145 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018894b-adca-4506-a8d2-970eadf5890d admin admin] Validating token access rules against request {{(pid=88124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:09:57.339130 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c06928-7f8c-4e35-95aa-91365dfb7feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:09:57.339789 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c06928-7f8c-4e35-95aa-91365dfb7feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:57.340093 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c06928-7f8c-4e35-95aa-91365dfb7feb admin admin] SCRIPT_NAME: `/identity` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:57.340363 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c06928-7f8c-4e35-95aa-91365dfb7feb admin admin] PATH_INFO: `/v3/users/e185aebff6764298b18baff8bb6a61c6` {{(pid=88124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:57.341449 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c06928-7f8c-4e35-95aa-91365dfb7feb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e185aebff6764298b18baff8bb6a61c6)` {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:09:57.343347 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c06928-7f8c-4e35-95aa-91365dfb7feb admin admin] RBAC: Authorization granted {{(pid=88124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:09:57.388201 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [None req-96c06928-7f8c-4e35-95aa-91365dfb7feb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e185aebff6764298b18baff8bb6a61c6'} {{(pid=88124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:09:57.388833 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [None req-96c06928-7f8c-4e35-95aa-91365dfb7feb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e185aebff6764298b18baff8bb6a61c6'} {{(pid=88124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:09:57.395709 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [None req-96c06928-7f8c-4e35-95aa-91365dfb7feb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e185aebff6764298b18baff8bb6a61c6'} {{(pid=88124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:09:57.396332 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [None req-96c06928-7f8c-4e35-95aa-91365dfb7feb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e185aebff6764298b18baff8bb6a61c6'} {{(pid=88124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:09:57.408588 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG keystone.notifications [None req-96c06928-7f8c-4e35-95aa-91365dfb7feb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e185aebff6764298b18baff8bb6a61c6'} {{(pid=88124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:09:57.410527 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:09:57.423106 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: [pid: 88124|app: 0|req: 629/1254] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 12:09:57 2022] DELETE /identity/v3/users/e185aebff6764298b18baff8bb6a61c6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:09:57.601234 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b2761-348b-4079-9d3d-d1744408c3c7 admin admin] Authenticating user token {{(pid=88125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:09:57.602993 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.fernet_utils [None req-740b2761-348b-4079-9d3d-d1744408c3c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:09:57.616209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b2761-348b-4079-9d3d-d1744408c3c7 admin admin] Validating token access rules against request {{(pid=88125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:09:57.673322 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51f9b6-6887-400c-b1f2-5275f8fa4aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371d9f7c2d964f04b62c347e6b182e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e314d339abaf4ce28ec0c1d1e6483dff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:09:57.673945 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51f9b6-6887-400c-b1f2-5275f8fa4aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:57.674221 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51f9b6-6887-400c-b1f2-5275f8fa4aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:57.674489 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51f9b6-6887-400c-b1f2-5275f8fa4aaf admin admin] PATH_INFO: `/v3/projects/4c4f01f819d549e0a4753da22a118738` {{(pid=88125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:57.675580 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51f9b6-6887-400c-b1f2-5275f8fa4aaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c4f01f819d549e0a4753da22a118738)` {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:09:57.677566 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51f9b6-6887-400c-b1f2-5275f8fa4aaf admin admin] RBAC: Authorization granted {{(pid=88125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:09:57.726209 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [None req-1c51f9b6-6887-400c-b1f2-5275f8fa4aaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c4f01f819d549e0a4753da22a118738', 'request_id': 'req-1c51f9b6-6887-400c-b1f2-5275f8fa4aaf'} {{(pid=88125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:09:57.732976 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [None req-1c51f9b6-6887-400c-b1f2-5275f8fa4aaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c4f01f819d549e0a4753da22a118738', 'request_id': 'req-1c51f9b6-6887-400c-b1f2-5275f8fa4aaf'} {{(pid=88125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:09:57.740707 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [None req-1c51f9b6-6887-400c-b1f2-5275f8fa4aaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c4f01f819d549e0a4753da22a118738', 'request_id': 'req-1c51f9b6-6887-400c-b1f2-5275f8fa4aaf'} {{(pid=88125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:09:57.751886 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [None req-1c51f9b6-6887-400c-b1f2-5275f8fa4aaf admin admin] The token cache is being invalidate because project 4c4f01f819d549e0a4753da22a118738 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:09:57.752276 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [None req-1c51f9b6-6887-400c-b1f2-5275f8fa4aaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:09:57.752939 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG keystone.notifications [None req-1c51f9b6-6887-400c-b1f2-5275f8fa4aaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:09:57.754457 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: [pid: 88125|app: 0|req: 626/1255] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 12:09:57 2022] DELETE /identity/v3/projects/4c4f01f819d549e0a4753da22a118738 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:10:07.421165 dv-osbrick-855012-2-ceph devstack@keystone.service[88124]: DEBUG dbcounter [-] [88124] Writing DB stats keystone:SELECT=4 {{(pid=88124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:07.748809 dv-osbrick-855012-2-ceph devstack@keystone.service[88125]: DEBUG dbcounter [-] [88125] Writing DB stats keystone:SELECT=63,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}